My experience with data science has been that we can go a long way with simple models, or even just descriptives. So it's often an exercise in software engineering to transform the data into whatever form we want. A lot of DS has been on social science data: sales, marketing, click rates, public opinion. These things are super noisy, so it's often less about the science and more about some weird politics, e.g., what is acceptable, or hunches about the future that aren't in the data. Really looking forward to read this blog!
"Data Scientists were expected to be just another form of Software Engineers" - this is the best case scenario... In the worst case you're a BI Analysts building dashboards and exporting .csv files 😂
If it does end up as just a blog about XGBoost I won't be mad!
yes, a BI analyst is far closer to data science than any software engineer
My experience with data science has been that we can go a long way with simple models, or even just descriptives. So it's often an exercise in software engineering to transform the data into whatever form we want. A lot of DS has been on social science data: sales, marketing, click rates, public opinion. These things are super noisy, so it's often less about the science and more about some weird politics, e.g., what is acceptable, or hunches about the future that aren't in the data. Really looking forward to read this blog!
Yes!!! MaDGA.... Sorry, had to do it
"Data Scientists were expected to be just another form of Software Engineers" - this is the best case scenario... In the worst case you're a BI Analysts building dashboards and exporting .csv files 😂
Strongly disagree. BI Analyst is far closer to what DS is all about.
The joke was that I'd rather be writing Python code than just exporting csvs for someone. You must have seen this kind of tweet before: https://x.com/sethrosen/status/1252291581320757249