Sunday, October 29, 2023

What fails AI ?

 The entire world talks about the hallucinations of AI ( incorrect answers), opacity of its workings, threat of job losses. But have you pondered what fails AI? what sabotages it and ensures its failure? When the models and tech come out of labs to the real world , what awaits them?

A very small percentage of AI projects get completed and deliver value. What comes in the way?

  1. Big 'D' : For a ChatGPT, the billions of parameters get fed with mountains of data from a number of open source/ commercial data. For a business model, the data resides in multiple locations owned by various stakeholders - commercial / regulatory/users/customers : almost none offering the data easily. The sources are difficult to access , data is of varying quality and trustworthiness. Connections are unreliable . Compliance /Geopolitical /Privacy concerns can shut off those data pipes without notice.
  2. Survivorship: With all the media talking up job losses, it is natural for people to get defensive. Exceptions and individual judgements are over-emphasized, early mistakes are magnified and model adoptions happen with varying levels of reservations.
  3. Trust : Data legacy and past experiences do not always contribute to users trusting the base data much less the decisions /predictions /recommendations.
  4. The invisible demons: Efforts to establish data pipelines, enhance /standardize data quality are underestimated and under staffed. For businesses looking to see quick results, these pose some real big obstacles.
  5. Dynamism of business : Market Place is not static. Customers/competition is changing continuously , Newer nuances come in that do not have history. Newer processes/ process attributes and market dynamics may mean the project contours may become drastically different.
  6. Costs of a right/wrong decision: Not every process needs to be as precise as a Japanese bullet train. Some times the manual processes / semi-automatic/automated processes are efficient enough and AI may not add incremental value to the extra cost.

While every project has its own challenges and surprises, AI projects tend to encounter unique situations . Planning and managing them could make a difference between real impact and a statistic.

No comments:

AI searches for human intelligence , to beat

  With all the hype about AI taking over humans and humans worried about their precious skills/role in this world risk getting diminished, l...