Good, lengthy and somewhat technical piece from O'Reilly. Worth reading. Quite a challenge out there. This will happen, and relatively soon. This is also why I think teaching everyone coding will not be a useful thing to do. It will be specialist work for a few. It will all be automated. Key will be to have people work with data sources and apply results. This is worth a read:
Deep Automation in Machine Learning
We need to do more than automate model building with autoML; we need to automate tasks at every stage of the data pipeline. By Ben Lorica, Mike Loukides in O'Reilly
In a previous post, we talked about applications of machine learning (ML) to software development, which included a tour through sample tools in data science and for managing data infrastructure. Since that time, Andrej Karpathy has made some more predictions about the fate of software development: he envisions a Software 2.0, in which the nature of software development has fundamentally changed. Humans no longer implement code that solves business problems; instead, they define desired behaviors and train algorithms to solve their problems. As he writes, “a neural network is a better piece of code than anything you or I can come up with in a large fraction of valuable verticals.” We won’t be writing code to optimize scheduling in a manufacturing plant; we’ll be training ML algorithms to find optimum performance based on historical data.
If humans are no longer needed to write enterprise applications, what do we do? Humans are still needed to write software, but that software is of a different type. Developers of Software 1.0 have a large body of tools to choose from: IDEs, CI/CD tools, automated testing tools, and so on. The tools for Software 2.0 are only starting to exist; one big task over the next two years is developing the IDEs for machine learning, plus other tools for data management, pipeline management, data cleaning, data provenance, and data lineage. ... "
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment