Connect with us

Technology

MIT’s New Algorithm Could Transform Urban Planning, Supply Chains and the Future of ‘Small Data’

MIT researchers have developed a breakthrough algorithm that identifies the smallest dataset needed to guarantee optimal decisions in complex real-world systems.

Published

on

Magazine 7
Illustrated image

When cities build new subway lines, they face an impossible dilemma long before construction begins: how do you identify the cheapest, safest path through hundreds of city blocks without spending years on costly field surveys? Urban planners typically assume that the only way to make an optimal choice is to collect as much data as possible — often far more than budgets, timelines, or logistics allow.

A new study from researchers at the Massachusetts Institute of Technology (MIT) challenges that assumption with a radically different idea: for many complex decisions, you don’t need more data — you just need the right data.

The team has developed a mathematical and algorithmic framework that can identify the smallest possible dataset required to guarantee an optimal decision, even in problems involving thousands of uncertainties. Their findings suggest that a city planning a subway line under Manhattan, or a utility operator optimizing an electricity grid, may be able to cut their data collection needs dramatically.

And the breakthrough doesn’t just reduce the burden of field surveys — it rewrites long-held beliefs about AI and the data economy.

“Data are one of the most important aspects of the AI economy. Models are trained on more and more data, consuming enormous computational resources. But most real-world problems have structure that can be exploited. We’ve shown that with careful selection, you can guarantee optimal solutions with a small dataset,”Asu Ozdaglar, head of MIT’s EECS department, in a statement issued as part of this research.

Rethinking the ‘Big Data’ Era

For over a decade, modern AI has pushed the narrative that “more data is always better.” But many real-world optimization problems — from supply chains and transit networks to energy markets — have predictable structural patterns. The MIT researchers argue that this structure can be used to determine exactly which data points matter.

This is crucial in systems like:subway route selection, supply chain diversification, electricity network optimization, construction planning, logistics and resource allocation.

In all these cases, practitioners often drown in unnecessary data collection, hoping volume will compensate for uncertainty.

The new algorithm takes the opposite approach: start with no data, and add only what is provably essential.

The Key Breakthrough

The team’s method begins by mathematically defining what it means for a dataset to be “sufficient.” They break the decision space into “optimality regions” — scenarios in which a particular route, price, or configuration becomes the best choice.

A dataset is sufficient if it can accurately determine which region the real world belongs to. “When we say a dataset is sufficient, we mean that it contains exactly the information needed to solve the problem. You don’t need to estimate all parameters accurately; you just need data that can discriminate between competing optimal solutions,” said Amine Bennouna, co-lead author.

Once the structure is defined, the algorithm repeatedly asks a critical question: “Is there any scenario in which the optimal decision could change, and my current data would fail to detect it?”

If the answer is yes, the algorithm identifies precisely which new measurement would fill that gap. If no, the dataset is complete — and provably sufficient.

This approach can shrink data collection from thousands of measurements to a handful.

“The algorithm guarantees that, for whatever scenario could occur within your uncertainty, you’ll identify the best decision,” Omar Bennouna, co-lead author, added.

From Manhattan Tunnels to Global Supply Chains

Consider the example of a subway planned beneath New York City. Every city block might hide different soil conditions, underground utilities, or hazard profiles. The traditional assumption: investigate everything.

The MIT model: investigate only the blocks that can change the optimal route, and ignore the rest.

The same applies to: selecting shipping routes in a congested supply chain,  configuring electrical grid nodes during volatile energy prices,  deciding where to place sensors in large infrastructure projects. This could save millions in surveys, simulations, and engineering assessments.

The researchers were able to show not only that minimal datasets exist — but that their algorithm can find them systematically, preserving optimality with mathematical certainty.

“We challenge this misconception that small data means approximate solutions. These are exact sufficiency results with mathematical proofs,” Saurabh Amin, co-senior author, said.

Why This Matters: Cost, Carbon, and Computational Savings

If AI models can be trained with fewer, smarter data points: computation becomes cheaper, energy consumption drops, model training becomes faster and policymakers can rely on faster decision cycles.

For large infrastructure projects, this could mean shaving months — even years — off planning timelines.

The team plans to expand the framework to more complex scenarios, including situations where data are noisy or partially observable — a common challenge in the real world.

Their work will be presented at the Conference on Neural Information Processing Systems (NeurIPS) — a major stage for breakthroughs that redefine how AI systems learn and make decisions.

If successful, this research could push the global AI ecosystem to rethink its data obsession. Instead of hoarding massive datasets, the future may lie in asking sharper questions — and collecting only the data that truly matters.

EP Staff is the editorial team at EdPublica, an independent media organisation focused on science, education, environment and public policy. The team produces evidence-based news, features, explainers and analysis on issues that shape society and everyday life.

EDUNEWS & VIEWS

If AI Can Explain Everything, What Is Left for a Teacher to Teach?

AI in education is changing the teacher’s role from delivering knowledge to developing critical thinking, ethical judgment and human skills.

Prof. (Dr.) Jyotsna Singh, Campus Director and Professor, NMIMS,

Published

on

AI in Education Is Changing What Teachers Need to Teach
As AI takes on the task of explaining and delivering knowledge, the role of the teacher is shifting towards critical thinking, mentorship and ethical judgment in higher education. Image credit: Kirubakaran Uthira Kumar/Pexels

AI in education is changing the teacher’s role from delivering information to developing critical thinking, ethical judgment, resilience and human connection. As AI becomes a powerful learning tool, teachers may become more important as mentors and guides.

Every few decades, technology forces higher education to step in front of an existential mirror. When search engines made the world’s information queryable in milliseconds, critics prematurely declared the traditional classroom obsolete. Today, as Generative AI (Artificial Intelligence) tools evolve from search interfaces into systems capable of explaining corporate finance models, writing complex code, and breaking down multi-variable calculus step-by-step, we face a far more provocative question: If AI can explain everything, what is actually left for a teacher to teach?

AI in Education Is Changing What Teachers Need to Teach

For decades, higher education was built on an implicit assumption that the teacher’s primary job was the delivery of content. The educator was the traditional authority figure holding access to knowledge and transmitting it to passive recipients. But if education is reduced merely to information delivery, AI will indeed render the traditional teacher redundant. As academic leaders navigating a multidisciplinary university environment, we know that information is not wisdom, and an explanation is not true understanding. As AI becomes a ubiquitous, hyper-efficient personal tutor, the role of the teacher is not shrinking; it is undergoing a profound and necessary elevation.

Generative AI models are exceptional at providing fast answers, but they are fundamentally indifferent to truth, context, and nuance. They synthesise probabilistic patterns rather than human meaning. In a time when students can produce a well-written study of a business case or legal precedent in a matter of seconds, the main responsibility of educators is to teach students how to evaluate answers rather than how to obtain them. In the era of artificial intelligence, critical thinking is now about rigorous investigation rather than knowledge retrieval. Instructors must teach students how to analyse AI outputs, including how to spot algorithmic bias, find logical fallacies, confront minute errors, and comprehend the moral trade-offs and human costs associated with important choices. An algorithm cannot match the human mind’s ability to navigate ambiguity, which is necessary to develop this level of critical judgment.

Higher education is also a very emotional and social process. Vulnerability is necessary for learning; a pupil must first own their ignorance in order to acquire new information. While an AI can adjust to a student’s cognitive tempo, it is unable to recognise the faint spark of inquiry in a quiet seminar room, read the exasperation on a student’s face, or detect a sudden lack of confidence before a significant presentation. Teachers work as mentors, fostering character, ethical responsibility, and resilience. They foster collaborative environments where leadership thrives, set an example of sensitivity, and encourage discussion among peers who hold different opinions. A machine can outline the technical concepts of corporate governance or bioethics, but only a human mentor can instil the moral compass required to lead responsibly in an unpredictable world.

If AI can explain the what and the how, the teacher remains the master of the why.

Instead of replacing teachers, AI presents a unique opportunity by relieving them of repetitious explanations and mundane administrative duties. Teachers might recover their primary role as learning architects by delegating foundational drills and basic synthesis to automated technologies. Project-based challenges, real-world simulations, and interdisciplinary discussions where human collaboration is unavoidable are replacing passive lectures in forward-thinking educational institutions. In order to help students identify their unique skills, intellectual interests, and sense of agency, they concentrate on posing open-ended questions that lack tidy, algorithmic solutions.

As we evaluate the future of our educational institutions, we should not view AI as a competitor to the teacher, but as a clarity-enforcing mirror. If AI can explain the what and the how, the teacher remains the master of the why. As technology democratises access to knowledge at an unprecedented scale, the human touch in education becomes more valuable, not less. The future belongs not to machines that hold all the answers, but to human beings who can think critically, act ethically, collaborate empathetically, and lead with purpose. Guiding young minds to that destination is something only a teacher can do.

Continue Reading

Technology

The AI That Helps Humans See When Self-Driving Cars Go Wrong

MIT researchers have developed an AI system that helps humans understand why self-driving cars make certain decisions. The technology could help safety drivers respond to failures, engineers investigate crashes and regulators better understand autonomous-vehicle behaviour.

Published

on

Cars and a city bus travel through busy urban traffic, illustrating connected and autonomous vehicle technology.
Connected and autonomous vehicle technologies could help vehicles respond to hazards in complex urban traffic. Representational image. Image credit: Lee Starry/Pexels

Researchers from MIT and autonomous vehicles technology company Motional have developed a system that could help humans understand what is happening inside an autonomous vehicle when it makes a decision. Called the Concept-Wrapper Network, or CW-Net, it translates parts of the vehicle’s decision-making into concepts humans can understand, such as “approaching stopped vehicle” or “close to cyclist.”

In one test, an autonomous vehicle repeatedly stopped when approaching a cyclist. The safety driver assumed the vehicle had detected the cyclist. CW-Net revealed otherwise: the system was not properly configured to detect the cyclist. The vehicle had stopped because its emergency-braking procedure was triggered when it got too close. The difference is important. If a human knows that the vehicle has failed to recognise a cyclist, they can slow down or take control sooner.

It raises a larger question for autonomous driving: when a vehicle makes a mistake, can humans understand the mistake quickly enough to respond?

When the Decision Comes from Software

Autonomous vehicles use cameras, lidar and other sensors to interpret their surroundings. Machine-learning systems then use that information to plan the vehicle’s movement. But deep-learning models can be difficult to interpret. Engineers may see what the vehicle detected and what it eventually did without having a clear view of the reasoning connecting the two.

That problem has already appeared in crash investigations. In March 2018, an Uber test vehicle operating with an automated driving system struck and killed a pedestrian in Tempe, Arizona. The US National Transportation Safety Board found that the system had detected the pedestrian but classified her at different points as an unknown object, a vehicle and a bicycle. Its predictions about her path also changed.

The investigation showed why an autonomous-vehicle crash can require a different kind of analysis. Investigators may need to determine not just what happened, but what the automated system detected, how it classified an object and what it predicted before deciding how the vehicle should move.

What Happens After a Crash?

The US National Highway Traffic Safety Administration requires specified manufacturers and operators to report certain crashes involving automated driving systems and Level 2 driver-assistance systems. For covered automated-driving-system crashes, the reporting order includes cases in which the system was engaged within 30 seconds of a crash meeting specified injury, fatality, towing or property-damage criteria.

Such reports give regulators information to identify safety concerns and investigate potential defects. But a crash report does not necessarily reveal every step in an AI system’s decision-making. NHTSA also notes that information in initial reports can be incomplete or unknown and may later be updated.

A 2024 case involving Cruise showed another side of the problem. NHTSA reached a consent order with Cruise over incomplete reporting related to crashes involving its automated-driving systems. Cruise agreed to pay a 1.5 million dollars civil penalty and submit a corrective action plan. Reuters reported that one of the cases involved a pedestrian who had first been struck by another vehicle and was then hit and dragged by a Cruise robotaxi.

The case was about reporting rather than AI interpretability. But it highlighted the importance of having reliable information when automated systems are involved in crashes.

Why Knowing “Why” Matters

Consider a vehicle that suddenly brakes. A passenger might assume that it has detected a pedestrian or another obstacle. But the same action could result from the system misunderstanding its surroundings and triggering an emergency response.
From outside, the vehicle’s behaviour looks the same. For the person supervising it, the difference can determine whether they trust the system or intervene.

CW-Net is designed to make some of the concepts influencing the vehicle’s planning visible. The researchers integrated the system into the machine-learning planner rather than generating an explanation only after the decision had been made. They say this makes the explanations causally connected to the vehicle’s behaviour.

Autonomous vehicles detecting pedestrians
An autonomous vehicle detects approaching pedestrians, illustrating how AI-powered systems can identify road hazards and make driving decisions in real time. Image credit: MIT News

The system was trained using 130 million examples of self-driving scenes with labelled concepts. In tests with a Motional autonomous vehicle on a private track, the explanations helped safety drivers predict vehicle behaviour more accurately. A larger simulation study using real driving situations from Las Vegas produced similar results among non-expert participants.

That does not mean CW-Net prevents crashes. Its potential value is more immediate: it can give humans information that may help them recognise a failure and give engineers another way to investigate it.

India is Moving Towards More Connected Vehicles

India’s immediate road-safety challenge is still conventional road crashes. At the same time, India is introducing technologies that allow vehicles to exchange and process more information about their surroundings. In August 2026, the Ministry proposed phased implementation of vehicle-to-vehicle communication. Under the draft proposal, L, M and N category vehicles manufactured from October 1, 2028 would be required to have V2V systems conforming to AIS-230. The proposed systems would allow vehicles to exchange information including speed, position, direction and acceleration.

The government says such communication could support warnings for sudden braking, forward collisions, unsafe lane changes and approaching emergency vehicles. V2V is not autonomous driving. It does not transfer control of the vehicle to an AI. But it is part of a broader shift towards vehicles relying more heavily on sensors, software and communication systems.

Reuters also reported in June that India had removed licensing requirements affecting spectrum used by automotive radar and V2X technologies, potentially making it easier to deploy some crash-avoidance and connected-vehicle technologies. As these systems become more sophisticated, understanding their failures becomes important too.

The Indian Question

An autonomous vehicle operating in India would have to navigate roads shared by cars, buses, motorcycles, bicycles and pedestrians, often in complex and unpredictable situations. That does not mean Indian roads are inherently unsuitable for autonomous driving. It does mean that automated systems need to be tested in the environments in which they are expected to operate, including unusual situations that can challenge their perception and decision-making.

This is where technologies such as CW-Net could eventually have a role. If a vehicle responds incorrectly, an understandable record of what influenced its decision could help a safety operator recognise the problem. The same information could help engineers identify weaknesses in the system and work on correcting them. For regulators and investigators, such information could also become useful when reconstructing what happened after a crash.

The goal, however, should not be to make people trust autonomous vehicles simply because the systems can explain themselves. An explanation is useful only when it is accurate and helps a person make a better decision. A self-driving car will still have to make the right decision. But when it does not, being able to understand where the decision went wrong could help humans respond sooner—and help engineers make the next system better.

Continue Reading

Technology

Meta’s $18 Billion Child-Safety Reckoning: Can Social Media Be Made Safer for Teens?

Meta’s 18 billion dollars child-safety settlement marks a major shift in how social media platforms are being held accountable for protecting young users, putting renewed focus on screen time, platform design and age verification.

Published

on

Two teenagers using smartphones in a dimly lit room, highlighting concerns around social media use and child online safety.
As social media platforms face growing scrutiny over teen safety, new measures are putting greater responsibility on companies to create safer digital spaces for young users. Representational image. Image credit: Ron Lach/Pexels

Meta has agreed to pay up to 18 billion dollars to settle a sweeping legal challenge brought by nearly all U.S. states over allegations that Facebook and Instagram were designed to keep children and teenagers engaged despite risks to their wellbeing. Announced on August 26, the settlement ends a major federal trial in California and requires Meta to introduce significant changes to how teenagers use its platforms. Meta has not admitted wrongdoing.

More importantly, the agreement reflects a changing approach to online child safety: platforms, rather than parents alone, are increasingly being held responsible for how their products affect children.

What will Change?

Under the agreement, teenagers will receive a default two-hour daily limit across Facebook and Instagram, although parents can override it. Meta will also introduce a default Night Mode, restricting use between midnight and 6 a.m. Notifications will be muted during school hours, from 8 a.m. to 3 p.m., except for direct messages and safety-related alerts.

Teenagers will receive reminders after extended periods of use and at certain daily-use thresholds. Meta will also strengthen age-assurance measures aimed at keeping children under 13 off its platforms. The measures are expected to remain in place for 10 years, with independent oversight of Meta’s compliance.

Financially, the settlement could reach 18 billion dollars. About 12.7 billion dollars is guaranteed over 10 years, while another 5.3 billion dollars is conditional on TikTok and YouTube adopting specified safety measures and making corresponding payments.

Tackling the Screen Time

The lawsuits were not simply about teenagers spending too much time online. States accused Meta of designing features that encouraged prolonged engagement while allegedly downplaying risks to young users. They also raised concerns over the collection and use of personal information from children under 13. That puts the focus on the architecture of social media itself.

Recommendation systems, notifications, engagement metrics and endless feeds can influence how long users remain on a platform. The larger question is whether companies should be responsible when those design choices contribute to harm among young users. The settlement pushes the debate towards platform responsibility rather than individual responsibility.

A hand holding a smartphone displaying the Threads app logo, with the Meta logo visible in the background.
Meta faces growing scrutiny over child safety on its social media platforms, following an $18 billion settlement over allegations that Facebook and Instagram encouraged prolonged engagement among young users. Representational image. Image credit: Julio Lopez/Pexels

Is Two Hours Enough?

A daily limit may reduce screen time, but it does not necessarily address what happens during those two hours. What content teenagers encounter, how algorithms recommend it and how platforms respond to vulnerable users remain important questions.

Meta’s advertising-driven business model also remains intact. The settlement does not fundamentally change the commercial incentives behind user engagement. But can social media be made safer simply by limiting how long children use it?

The Age-verification Dilemma

The agreement also highlights another challenge: how platforms determine who is a child. Stronger age assurance can make it harder for children to bypass restrictions. But systems involving facial analysis, identity checks or other forms of age estimation can create new privacy risks.

Protecting children online, therefore, also requires deciding how much information platforms should collect to establish a user’s age.

A Test for the Industry

Although the settlement applies to Meta’s U.S. services, its implications extend beyond the company. Meta is calling on TikTok and YouTube to adopt similar safeguards, potentially pushing child-safety measures towards an industry-wide standard.

The settlement could ultimately prove to be less about the 18 billion dollars than about who bears responsibility for children’s digital lives. For years, parents have been asked to manage screen time, adjust settings and monitor what children see online.

Meta’s settlement suggests a different expectation: if platforms are built in ways that can affect children, the platforms themselves may have to change. The next decade will show whether that shift can produce a genuinely safer social-media environment for young users.

Continue Reading

Trending