Connect with us

Technology

The AI That Helps Humans See When Self-Driving Cars Go Wrong

MIT researchers have developed an AI system that helps humans understand why self-driving cars make certain decisions. The technology could help safety drivers respond to failures, engineers investigate crashes and regulators better understand autonomous-vehicle behaviour.

Published

on

Cars and a city bus travel through busy urban traffic, illustrating connected and autonomous vehicle technology.
Connected and autonomous vehicle technologies could help vehicles respond to hazards in complex urban traffic. Representational image. Image credit: Lee Starry/Pexels

Researchers from MIT and autonomous vehicles technology company Motional have developed a system that could help humans understand what is happening inside an autonomous vehicle when it makes a decision. Called the Concept-Wrapper Network, or CW-Net, it translates parts of the vehicle’s decision-making into concepts humans can understand, such as “approaching stopped vehicle” or “close to cyclist.”

In one test, an autonomous vehicle repeatedly stopped when approaching a cyclist. The safety driver assumed the vehicle had detected the cyclist. CW-Net revealed otherwise: the system was not properly configured to detect the cyclist. The vehicle had stopped because its emergency-braking procedure was triggered when it got too close. The difference is important. If a human knows that the vehicle has failed to recognise a cyclist, they can slow down or take control sooner.

It raises a larger question for autonomous driving: when a vehicle makes a mistake, can humans understand the mistake quickly enough to respond?

When the Decision Comes from Software

Autonomous vehicles use cameras, lidar and other sensors to interpret their surroundings. Machine-learning systems then use that information to plan the vehicle’s movement. But deep-learning models can be difficult to interpret. Engineers may see what the vehicle detected and what it eventually did without having a clear view of the reasoning connecting the two.

That problem has already appeared in crash investigations. In March 2018, an Uber test vehicle operating with an automated driving system struck and killed a pedestrian in Tempe, Arizona. The US National Transportation Safety Board found that the system had detected the pedestrian but classified her at different points as an unknown object, a vehicle and a bicycle. Its predictions about her path also changed.

The investigation showed why an autonomous-vehicle crash can require a different kind of analysis. Investigators may need to determine not just what happened, but what the automated system detected, how it classified an object and what it predicted before deciding how the vehicle should move.

What Happens After a Crash?

The US National Highway Traffic Safety Administration requires specified manufacturers and operators to report certain crashes involving automated driving systems and Level 2 driver-assistance systems. For covered automated-driving-system crashes, the reporting order includes cases in which the system was engaged within 30 seconds of a crash meeting specified injury, fatality, towing or property-damage criteria.

Such reports give regulators information to identify safety concerns and investigate potential defects. But a crash report does not necessarily reveal every step in an AI system’s decision-making. NHTSA also notes that information in initial reports can be incomplete or unknown and may later be updated.

A 2024 case involving Cruise showed another side of the problem. NHTSA reached a consent order with Cruise over incomplete reporting related to crashes involving its automated-driving systems. Cruise agreed to pay a 1.5 million dollars civil penalty and submit a corrective action plan. Reuters reported that one of the cases involved a pedestrian who had first been struck by another vehicle and was then hit and dragged by a Cruise robotaxi.

The case was about reporting rather than AI interpretability. But it highlighted the importance of having reliable information when automated systems are involved in crashes.

Why Knowing “Why” Matters

Consider a vehicle that suddenly brakes. A passenger might assume that it has detected a pedestrian or another obstacle. But the same action could result from the system misunderstanding its surroundings and triggering an emergency response.
From outside, the vehicle’s behaviour looks the same. For the person supervising it, the difference can determine whether they trust the system or intervene.

CW-Net is designed to make some of the concepts influencing the vehicle’s planning visible. The researchers integrated the system into the machine-learning planner rather than generating an explanation only after the decision had been made. They say this makes the explanations causally connected to the vehicle’s behaviour.

Autonomous vehicles detecting pedestrians
An autonomous vehicle detects approaching pedestrians, illustrating how AI-powered systems can identify road hazards and make driving decisions in real time. Image credit: MIT News

The system was trained using 130 million examples of self-driving scenes with labelled concepts. In tests with a Motional autonomous vehicle on a private track, the explanations helped safety drivers predict vehicle behaviour more accurately. A larger simulation study using real driving situations from Las Vegas produced similar results among non-expert participants.

That does not mean CW-Net prevents crashes. Its potential value is more immediate: it can give humans information that may help them recognise a failure and give engineers another way to investigate it.

India is Moving Towards More Connected Vehicles

India’s immediate road-safety challenge is still conventional road crashes. At the same time, India is introducing technologies that allow vehicles to exchange and process more information about their surroundings. In August 2026, the Ministry proposed phased implementation of vehicle-to-vehicle communication. Under the draft proposal, L, M and N category vehicles manufactured from October 1, 2028 would be required to have V2V systems conforming to AIS-230. The proposed systems would allow vehicles to exchange information including speed, position, direction and acceleration.

The government says such communication could support warnings for sudden braking, forward collisions, unsafe lane changes and approaching emergency vehicles. V2V is not autonomous driving. It does not transfer control of the vehicle to an AI. But it is part of a broader shift towards vehicles relying more heavily on sensors, software and communication systems.

Reuters also reported in June that India had removed licensing requirements affecting spectrum used by automotive radar and V2X technologies, potentially making it easier to deploy some crash-avoidance and connected-vehicle technologies. As these systems become more sophisticated, understanding their failures becomes important too.

The Indian Question

An autonomous vehicle operating in India would have to navigate roads shared by cars, buses, motorcycles, bicycles and pedestrians, often in complex and unpredictable situations. That does not mean Indian roads are inherently unsuitable for autonomous driving. It does mean that automated systems need to be tested in the environments in which they are expected to operate, including unusual situations that can challenge their perception and decision-making.

This is where technologies such as CW-Net could eventually have a role. If a vehicle responds incorrectly, an understandable record of what influenced its decision could help a safety operator recognise the problem. The same information could help engineers identify weaknesses in the system and work on correcting them. For regulators and investigators, such information could also become useful when reconstructing what happened after a crash.

The goal, however, should not be to make people trust autonomous vehicles simply because the systems can explain themselves. An explanation is useful only when it is accurate and helps a person make a better decision. A self-driving car will still have to make the right decision. But when it does not, being able to understand where the decision went wrong could help humans respond sooner—and help engineers make the next system better.

EP Staff is the editorial team at EdPublica, an independent media organisation focused on science, education, environment and public policy. The team produces evidence-based news, features, explainers and analysis on issues that shape society and everyday life.

Technology

What is AGI? AI’s Next Era: When Machines Start Taking on the Work

As AI systems move from answering prompts to handling complex, multi-step tasks, the boundary between today’s AI agents and the broader idea of artificial general intelligence is becoming harder to ignore. This article examines what AGI means, how autonomous AI is changing knowledge work, and what the shift could mean for India.

Published

on

A programmer works at a desk with multiple screens displaying computer code.
A programmer works with code across multiple screens, reflecting the growing role of AI in software development and autonomous coding. Representational image. Image credit: Mikhail Nilov/Pexels

The next phase of artificial intelligence is taking shape inside the companies building it. AI agents are being trained to handle hours-long assignments, while researchers are using AI to write code, investigate technical problems and help develop the next generation of AI systems. AGI generally refers to an AI system capable of learning, reasoning and applying knowledge across a broad range of tasks, rather than being limited to a narrow set of functions.

There is no universally accepted definition or test for AGI, so there is still no agreed threshold for declaring that a system has reached it. But many jobs gradually moving into automation, pushing thousands into uncertainty might help us understand the whole story.

OpenAI says more than 70% of sampled Codex users in May 2026 asked the coding agent to handle tasks estimated to take more than an hour. About a quarter made at least one request estimated at more than eight hours. Anthropic reported in August that Claude was leading 26% of the AI research and development work covered by its internal measurement system, compared with less than 1% in February. Both figures come from the companies themselves and are not measures of the wider economy.

For most people, AI is still something they consult. Ask a question, get an answer. Give it a document, get a summary. Ask for code, get code. That model is changing. The newer systems can take an assignment, break it into steps, use software and other tools, check their progress and continue working with less human intervention.

What happens when AI can handle much more of the work itself? That question sits at the heart of the debate over artificial general intelligence, or AGI.

From Prompts to Assignments

A programmer can ask AI to write a function. An agent can be given a larger job: inspect an existing project, build a feature, run tests, find problems and make corrections. The AI is handling a sequence of tasks rather than producing one answer. That distinction could eventually change how many kinds of knowledge work are organised.

AGI: Two people count stacks of cash at a table with digital code and data displayed in the background.
People handle cash at a counting table as digital code and data appear on a projected screen, illustrating the changing relationship between technology, automation and work. Representational image. Image credit: Tima Miroshnichenko/Pexels

AI is Helping Build AI

Frontier AI companies are already making the change clear. OpenAI says it has developed an “automated research intern” capable of performing defined research tasks under human direction. The company says it is working towards an automated AI researcher by March 2028.

Anthropic’s August figures point in the same direction. The company says Claude is increasingly being used in its own AI research and development, although it remains dependent on human researchers and is not fully autonomous in the measured work. AI is helping researchers build better AI.

So, When does AGI Arrive?

Researchers disagree about the capabilities AGI should demonstrate, and no accepted test exists. Google DeepMind CEO Demis Hassabis said in May that he expected AGI could arrive within roughly four years, possibly sooner. If an AI can research a subject, analyse data, write software, use several digital tools and complete a complex assignment, how much of that work still needs to be done by a person? Work will change before we have an answer.

A researcher could delegate a literature review and data analysis. A programmer could hand over an entire software feature. Some tasks may disappear from jobs. Others may become faster. New work will emerge around supervising, testing and governing AI systems.

India is Preparing for the Shift

India is investing heavily in the infrastructure needed for the next phase of AI. The IndiaAI Mission has an approved outlay of ₹10,371.92 crore over five years. The government said in August 2026 that more than 45,000 GPUs had been onboarded through its shared computing programme and 237 projects had accessed subsidised capacity. Twenty indigenous foundation-model proposals had also been selected from 506 applications.

AI systems need to work across Indian languages and very different economic and institutional settings. OpenAI announced an India initiative with Tata Group in February covering areas including AI infrastructure and local capability. Google DeepMind has partnered with Indian institutions on applications in science, education, agriculture and energy.

It becomes harder when an AI system spends hours researching, writing code, analysing information and making decisions before presenting a result. The human role will increasingly involve setting the objective, judging evidence and deciding when a system should be trusted. AGI remains undefined, and nobody can put a reliable date on its arrival. But the shift towards more autonomous AI is already visible.

Continue Reading

Technology

India’s AI Moment Rests on More Than Code

India has assembled many of the building blocks of an AI economy: capital, talent, research and startups. But its next phase will depend as much on chips, electricity, skills and policy as on software, exposing the gap between rapid growth and the systems needed to sustain it.

Published

on

featured 4

India’s AI ambitions are now reflected in global rankings, investment flows and Bengaluru’s emergence as a lead ing innovation hub. Yet the numbers reveal only part of the story. Much of the hardware is imported, demand for skilled workers continues to outpace supply, and the infrastructure pow ering AI faces growing pressure. The country’s next challenge is no longer adopting AI, but building the industrial and social foundations that can sus tain its growth.

j2 1

The Hardware Production Gap

The IndiaAI Mission has deployed over 38,000 GPUs and TPUs across domestic data centres. Registered startups and researchers can access this compute at ₹115–150 per GPU hour, roughly 42% cheaper than com mercial cloud rates. The governmentplans to scale this to 100,000 GPUs by December 2026. Not one of these chips is made in India. Every GPU in that stack is sourced from the same export controls that cut China off from this hardware exist as legal authority that could, under different political conditions, apply to India too.

A US India trade framework announced in February this year includes language protecting India’s chip access, but it depends on ongoing political align ment. Budget 2026–27 allocated ₹8,000 crore to the semiconductor and display manufacturing ecosystem programme, the largest single-year outlay since the mission launched, with a separate ₹1,000 crore for India Semiconductor Mission 2.0. The Tata PSMC fabrication plant at Dholera is targeting trial production by late 2026. But these plants are not building AI grade chips.

India’s Sovereign AI

At the IndiaAI Impact Summit 2026, three models were introduced: Sarvam AI, BharatGen, Gnani.ai. BharatGen has assembled over 15,000 hours of annotated voice data across 22 Indian languages. Sarvam’s Vision model, a 3-billion-parameter doc ument intelligence system, scored 84.3% on a standard OCR benchmark, outperforming Google Gemini 3 Pro (80.2%) and OpenAI’s GPT 5.2 (69.8%). Bhashini-v2, launched in early 2026, offers AI-powered translation across all 22 scheduled Indian languages and serves 140 million users on the MyGov platform. India is constructing the language of sovereignty. Indigenous models, na tional compute, and mission branding. But the engine underneath runs on hardware it cannot make and may not always be allowed to import.

The Jobless Economic Growth

India’s IT sector has long been the engine of middle-class stability, con tributing about 7.3% to GDP, employing over 5.8 million people directly, and creating the white-collar jobs that drove spending across housing, edu cation, and retail. That engine is under pressure from the same technology India is racing to lead. Particularly for mid-level coding, BPO, and testing roles that form the bulk of jobs in India. TCS announced 12,000 layoffs in 2025; Infosys and Wipro followed. Across the sector, jobs have been cut in what companies call strategic realignment.

j3 1

NITI Aayog’s October 2025 report projected that in a worst-case sce nario headcount could fall to 6 million by 2031. In April 2026, global equity re search firm Bernstein wrote an open letter to Prime Minister Modi warning that India’s 10 to 15 million IT services, GCC, and BPO workforce faces direct exposure to AI-driven automation. Sonal Varma, chief economist for India and Asia ex-Japan at Nomura, said: “Entry-level routine jobs are being displaced, and mid-level jobs are transforming. India needs to create about 8 million jobs annually.’’

Skill Set for the Emerging Sector

AI DevOps engineers, data centre operators, ethical AI auditors are the major emerging roles. But they require skill sets entirely different from the mass-hiring model that built the IT sector. An IIM-Ahmedabad study found that 68% of white-collar work ers fear automation within five years; 55% have adopted AI tools, but only 48% have received any training. India produces over 1.5 million engineering graduates annually but ranks 18th globally in skills alignment and 73rd in human capital in terms of AI. Graduate volume is not the same as workforce depth.

In that way adoption without re skilling becomes exposure to disrup tion dressed up as progress. NASSCOM projects that the broader AI push could generate 750,000 jobs and add $500 billion in economic value by 2030. Whether they reach the workers being displaced depends on whether India can close the gap between how many people it trains and how well it trains them. It is a gap that every major index in 2026 has documented and none has resolved.

The Climate Bill

There is a cost to India’s AI ambitions that doesn’t appear in invest ment announcements is the physical climate risk accumulating around the infrastructure meant to run it all. A report by climate risk consul tancy assessed 2,595 planned data centres worldwide, examining risks of direct physical damage from climate hazards, operational disruption from extreme heat.

For India, the country ranks 11th globally in physical climate risk to planned data centre infrastruc ture. The more concerning finding is where that risk concentrates. Tamil Nadu, Telangana, and Karnataka, three of India’s major data centre corridors are among the top 30 regions globally for projected operational disruption from extreme heat. South Asia as a whole has one of the highest pro portions of high-risk planned facil ities globally, with risk projected to increase sharply toward the end of the century.

j4 1

Data centres require large-scale cooling to keep servers running. Rising ambient temperatures increase cooling costs, strain electricity grids, and raise the probability of outag es. Countries including India, Brazil, Mexico, Indonesia, and Spain already record some of the highest projected operational disruption risks from heat globally, with more than 75% of anal ysed facilities classified as high risk. Productivity losses become ten times higher with indirect risks like power outages, water shortages, infrastructure failures.

India’s data centre ecosystem is concentrated in heat-exposed regions with al ready-strained urban infrastructure. Future vulnerability can be reduced by adequate planning during site selection, engineering standards, and resilience investment. Microsoft has committed $17.5 billion to Indian data centre expansion. Google is building a hub in Andhra Pradesh with a $15 billion commitment. Amazon has pledged $48 billion through 2030. At this stage, planning choices that are made now determine the risk profile for the next three decades. India has no mandatory national standard governing data centre siting or construction for climate resilience. This gap is no longer a future problem.

Where the Momentum Meets Reality

The 190% growth in Bengaluru’s ecosystem, the indigenous models outperforming global benchmarks, the public compute infrastructure being built at scale are all substantiated achievements. The QS Index gives In dia a perfect score of 100 on economic capacity and ranks it fifth globally in the “Future of Work” category. “The IndiaAI Mission represents substan tive, measurable progress, not merely a policy optics exercise.”

But the gaps are structural. The top ten Indian cities account for nearly half of all AI users while representing less than 10% of the population. The choices being made about who controls the technology, who gets the jobs, who bears the risks will deter mine whether this moment becomes something real or just another set of promises that get quietly shelved. What happens in policy rooms and planning offices will have to answer it.

Continue Reading

Technology

As AI Workers Warn of Risks, Researchers Seek Better Guardrails

Former AI workers are warning about the risks of increasingly capable AI systems. MIT researchers have developed HardFlow to enforce strict constraints while preserving the model’s ability to find better solutions.

Published

on

Conceptual image of two humanoid figures facing each other with barbed wire around their heads and necks, representing AI risks and safety constraints.
Conceptual representation of the growing concerns over AI safety and the need to keep increasingly capable AI systems within defined limits. Representational image. Image credit: Shubham Dhage/Pexels

AI agents are beginning to do more than answer questions. They can browse the internet, use software, interact with external systems and act on a user’s behalf. That greater autonomy is also producing a new AI safety category of failures: situations in which an AI system does something its user did not intend or cannot easily control.

A new research registry published this month documents a growing body of reported incidents involving AI agents and distinguishes real-world failures from controlled safety demonstrations. Its authors found that cases involving actual harm are concentrated among incidents occurring in the wild and those linked to safety failures.

AI Safety and People Building the Systems.

Former Google DeepMind research engineer Bilal Chughtai warned this week that advanced AI could pose an extreme threat to humanity. His resignation in July was followed by public warnings from Jacob Coxon, a former researcher at Anthropic and OpenAI. At Anthropic, researcher Evan Hubinger has estimated that there is a greater than 10% chance of a catastrophic AI outcome within the next decade.

Anthropic CEO Dario Amodei has called for a slowdown in frontier AI development, while OpenAI CEO Sam Altman has also argued for greater coordination around increasingly capable systems.

Against this backdrop, a team of MIT researchers is tackling a narrower but increasingly relevant problem: how do you give generative AI enough freedom to find good solutions without allowing it to violate rules that cannot be broken?

When Almost Right is Not Enough

For a generative model, a plausible answer is often considered a success. That standard does not work when the output controls a robot, a physical process or another system with strict operating limits. A robot planning a route through a factory, for instance, cannot simply find a path that is unlikely to collide with a worker. It has to avoid the collision. These non-negotiable requirements are known as hard constraints.

One way of enforcing them is to constrain the model repeatedly as it generates an answer. But that can narrow its search too early, preventing it from finding a better solution. MIT researchers Zeyang Li, Kaveh Alim and Navid Azizan have developed HardFlow, a method that takes a different approach.

Instead of forcing every intermediate step to satisfy the constraints, HardFlow allows the model more freedom while it searches and steers the generation process towards a final output that meets the required conditions. The researchers frame this as a trajectory-optimisation problem, drawing on optimal control theory.

They also break the computational problem into smaller steps so the method can be used at deployment time without retraining the underlying generative model. In experiments involving robotic manipulation, maze navigation, physical-process control and text-guided image editing, HardFlow satisfied the specified constraints while producing higher-quality solutions than competing methods.

The significance is narrower than the wider AI safety debate, but that may be precisely what makes the work useful. HardFlow does not attempt to solve every problem associated with increasingly autonomous AI. It addresses a practical question: how can a model retain the freedom to search for a good answer while ensuring that the final answer stays within boundaries that cannot be negotiated?

As AI systems gain greater autonomy, that distinction may become increasingly important. The challenge is not simply to make AI more capable, but to ensure that capability operates within limits that remain under human control.

Continue Reading

Trending