Connect with us

Technology

MIT’s New Algorithm Could Transform Urban Planning, Supply Chains and the Future of ‘Small Data’

MIT researchers have developed a breakthrough algorithm that identifies the smallest dataset needed to guarantee optimal decisions in complex real-world systems.

Published

on

Magazine 7
Illustrated image

When cities build new subway lines, they face an impossible dilemma long before construction begins: how do you identify the cheapest, safest path through hundreds of city blocks without spending years on costly field surveys? Urban planners typically assume that the only way to make an optimal choice is to collect as much data as possible — often far more than budgets, timelines, or logistics allow.

A new study from researchers at the Massachusetts Institute of Technology (MIT) challenges that assumption with a radically different idea: for many complex decisions, you don’t need more data — you just need the right data.

The team has developed a mathematical and algorithmic framework that can identify the smallest possible dataset required to guarantee an optimal decision, even in problems involving thousands of uncertainties. Their findings suggest that a city planning a subway line under Manhattan, or a utility operator optimizing an electricity grid, may be able to cut their data collection needs dramatically.

And the breakthrough doesn’t just reduce the burden of field surveys — it rewrites long-held beliefs about AI and the data economy.

“Data are one of the most important aspects of the AI economy. Models are trained on more and more data, consuming enormous computational resources. But most real-world problems have structure that can be exploited. We’ve shown that with careful selection, you can guarantee optimal solutions with a small dataset,”Asu Ozdaglar, head of MIT’s EECS department, in a statement issued as part of this research.

Rethinking the ‘Big Data’ Era

For over a decade, modern AI has pushed the narrative that “more data is always better.” But many real-world optimization problems — from supply chains and transit networks to energy markets — have predictable structural patterns. The MIT researchers argue that this structure can be used to determine exactly which data points matter.

This is crucial in systems like:subway route selection, supply chain diversification, electricity network optimization, construction planning, logistics and resource allocation.

In all these cases, practitioners often drown in unnecessary data collection, hoping volume will compensate for uncertainty.

The new algorithm takes the opposite approach: start with no data, and add only what is provably essential.

The Key Breakthrough

The team’s method begins by mathematically defining what it means for a dataset to be “sufficient.” They break the decision space into “optimality regions” — scenarios in which a particular route, price, or configuration becomes the best choice.

A dataset is sufficient if it can accurately determine which region the real world belongs to. “When we say a dataset is sufficient, we mean that it contains exactly the information needed to solve the problem. You don’t need to estimate all parameters accurately; you just need data that can discriminate between competing optimal solutions,” said Amine Bennouna, co-lead author.

Once the structure is defined, the algorithm repeatedly asks a critical question: “Is there any scenario in which the optimal decision could change, and my current data would fail to detect it?”

If the answer is yes, the algorithm identifies precisely which new measurement would fill that gap. If no, the dataset is complete — and provably sufficient.

This approach can shrink data collection from thousands of measurements to a handful.

“The algorithm guarantees that, for whatever scenario could occur within your uncertainty, you’ll identify the best decision,” Omar Bennouna, co-lead author, added.

From Manhattan Tunnels to Global Supply Chains

Consider the example of a subway planned beneath New York City. Every city block might hide different soil conditions, underground utilities, or hazard profiles. The traditional assumption: investigate everything.

The MIT model: investigate only the blocks that can change the optimal route, and ignore the rest.

The same applies to: selecting shipping routes in a congested supply chain,  configuring electrical grid nodes during volatile energy prices,  deciding where to place sensors in large infrastructure projects. This could save millions in surveys, simulations, and engineering assessments.

The researchers were able to show not only that minimal datasets exist — but that their algorithm can find them systematically, preserving optimality with mathematical certainty.

“We challenge this misconception that small data means approximate solutions. These are exact sufficiency results with mathematical proofs,” Saurabh Amin, co-senior author, said.

Why This Matters: Cost, Carbon, and Computational Savings

If AI models can be trained with fewer, smarter data points: computation becomes cheaper, energy consumption drops, model training becomes faster and policymakers can rely on faster decision cycles.

For large infrastructure projects, this could mean shaving months — even years — off planning timelines.

The team plans to expand the framework to more complex scenarios, including situations where data are noisy or partially observable — a common challenge in the real world.

Their work will be presented at the Conference on Neural Information Processing Systems (NeurIPS) — a major stage for breakthroughs that redefine how AI systems learn and make decisions.

If successful, this research could push the global AI ecosystem to rethink its data obsession. Instead of hoarding massive datasets, the future may lie in asking sharper questions — and collecting only the data that truly matters.

EP Staff is the editorial team at EdPublica, an independent media organisation focused on science, education, environment and public policy. The team produces evidence-based news, features, explainers and analysis on issues that shape society and everyday life.

Society

Digital Detox: Why Taking a Break From Screens Matters

A digital detox can help children and adults reduce screen dependence, reconnect with nature and relationships, and create space for reflection and creativity.

Anoop Krishnan H

Published

on

digital detox
Image credit: Darina Belonogova/Pexels

A digital holiday can offer a practical pause from screens and constant connectivity. From children to working professionals, taking regular time offline can help rebuild attention, creativity, relationships and a healthier balance with technology. A digital detox can help children and adults reduce screen dependence, reconnect with nature and relationships, and create space for reflection and creativity.

Imagine a day without digital devices. Those of us who grew up in the 1990s remember the shift firsthand — from writing letters with ink pens to typing messages on social media and making video calls. Artificial intelligence and rapid technological change now touch nearly every part of daily life, and an internet-first era has drawn humanity into a globally connected network. We ask AI chatbots for advice on everything from recipes to relationships. Yet the love of books and literature hasn’t disappeared — it has simply changed form. Audiobook platforms have grown fast, gaining listeners who once preferred print. At the same time, attention spans are shrinking as short-form video reshapes how we consume information. In an era built around likes, shares and instant search results, there is a real case for finding a better balance between online and offline living.

Children under 16 in particular need more exposure to offline living, and less dependence on screens. Time away from devices helps children build social skills, sharpen critical thinking, and learn to approach problems from multiple angles — all of which support holistic personal development.

Of course, context matters. During the Covid-19 pandemic, online education became the only option once lockdowns were imposed, and digital learning kept formal education running when nothing else could. But in a post-pandemic world, governments are increasingly reconsidering how much unsupervised screen time is appropriate for children. China’s “minor mode” framework restricts screen time by age; the United Kingdom has moved to ban social media for under-16s from 2027; and New Zealand has introduced legislation to do the same. In India, Karnataka announced in its 2026 state budget that it would ban social media use for under-16s, and Goa’s government has said it is studying a similar move. The details of enforcement remain unsettled in most of these cases, but the direction of the debate is clear: policymakers across the world are actively discussing how to limit children’s social media access. A middle path — rather than an outright ban — is worth considering.

Digital Detox Awareness

Schools are well placed to lead here. A monthly digital detox awareness session, run by trained resource persons and built around hands-on, creative activities, could help draw out children’s imagination while gently reducing screen dependence. Students could keep a diary of their experience — what they noticed, what they missed, what surprised them — during each digital detox day. Over time, schools could even form “digital holiday clubs” to mark one day a month as a shared offline day. Practised consistently through school life, this could help a generation grow into adults with more clarity of thought and purpose — provided they use that offline time for something creative and productive, rather than simply waiting it out.

In practice, a life entirely without the internet isn’t realistic for most of us. But digital minimalism is achievable, and a single digital holiday once a month is a reasonable place to start. Switching off completely for one day can open space for new ideas and reconnect us with the natural world.

That day can also be a chance for self-reflection — a deliberate pause to look inward. It can be used to build a skill: writing, cooking, dancing, whatever draws you. It’s an opportunity for offline meetups with friends and family, for cycling a short distance, for reading a book purely because you chose it, not because an algorithm suggested it. A digital holiday can help you rediscover what actually matters to you and reset your priorities. It also strengthens real relationships — the kind built through presence, not notifications — and leaves room for practices like yoga and meditation that support genuine mental peace.

Digital Detox Is Harder for Working Professionals

For working professionals, this is harder. Most of us are running behind deadlines, structuring our days around work and family obligations already. Stepping outside that loop, even for a day, takes real intention. But the practice of digital detox is worth the friction — it teaches delayed gratification and reintroduces us to the quieter pleasures of offline living.

None of this is a case against technology. Instant messaging and the broader digital revolution have made services faster and more accessible than ever, and that’s worth acknowledging. But speed and convenience come with a cost if we let them: information overload, and an over-reliance on AI chatbots for decisions that deserve real human judgement. Blindly following AI-generated advice isn’t something to encourage. The internet is a necessity now — but that makes the case for balance stronger, not weaker.

Reconnect with nature. Spend real time with the people who matter to you. And once in a while, take the leap: switch off for a day, and notice the difference it makes.

Continue Reading

Technology

What is AGI? AI’s Next Era: When Machines Start Taking on the Work

As AI systems move from answering prompts to handling complex, multi-step tasks, the boundary between today’s AI agents and the broader idea of artificial general intelligence is becoming harder to ignore. This article examines what AGI means, how autonomous AI is changing knowledge work, and what the shift could mean for India.

Published

on

A programmer works at a desk with multiple screens displaying computer code.
A programmer works with code across multiple screens, reflecting the growing role of AI in software development and autonomous coding. Representational image. Image credit: Mikhail Nilov/Pexels

The next phase of artificial intelligence is taking shape inside the companies building it. AI agents are being trained to handle hours-long assignments, while researchers are using AI to write code, investigate technical problems and help develop the next generation of AI systems. AGI generally refers to an AI system capable of learning, reasoning and applying knowledge across a broad range of tasks, rather than being limited to a narrow set of functions.

There is no universally accepted definition or test for AGI, so there is still no agreed threshold for declaring that a system has reached it. But many jobs gradually moving into automation, pushing thousands into uncertainty might help us understand the whole story.

OpenAI says more than 70% of sampled Codex users in May 2026 asked the coding agent to handle tasks estimated to take more than an hour. About a quarter made at least one request estimated at more than eight hours. Anthropic reported in August that Claude was leading 26% of the AI research and development work covered by its internal measurement system, compared with less than 1% in February. Both figures come from the companies themselves and are not measures of the wider economy.

For most people, AI is still something they consult. Ask a question, get an answer. Give it a document, get a summary. Ask for code, get code. That model is changing. The newer systems can take an assignment, break it into steps, use software and other tools, check their progress and continue working with less human intervention.

What happens when AI can handle much more of the work itself? That question sits at the heart of the debate over artificial general intelligence, or AGI.

From Prompts to Assignments

A programmer can ask AI to write a function. An agent can be given a larger job: inspect an existing project, build a feature, run tests, find problems and make corrections. The AI is handling a sequence of tasks rather than producing one answer. That distinction could eventually change how many kinds of knowledge work are organised.

AGI: Two people count stacks of cash at a table with digital code and data displayed in the background.
People handle cash at a counting table as digital code and data appear on a projected screen, illustrating the changing relationship between technology, automation and work. Representational image. Image credit: Tima Miroshnichenko/Pexels

AI is Helping Build AI

Frontier AI companies are already making the change clear. OpenAI says it has developed an “automated research intern” capable of performing defined research tasks under human direction. The company says it is working towards an automated AI researcher by March 2028.

Anthropic’s August figures point in the same direction. The company says Claude is increasingly being used in its own AI research and development, although it remains dependent on human researchers and is not fully autonomous in the measured work. AI is helping researchers build better AI.

So, When does AGI Arrive?

Researchers disagree about the capabilities AGI should demonstrate, and no accepted test exists. Google DeepMind CEO Demis Hassabis said in May that he expected AGI could arrive within roughly four years, possibly sooner. If an AI can research a subject, analyse data, write software, use several digital tools and complete a complex assignment, how much of that work still needs to be done by a person? Work will change before we have an answer.

A researcher could delegate a literature review and data analysis. A programmer could hand over an entire software feature. Some tasks may disappear from jobs. Others may become faster. New work will emerge around supervising, testing and governing AI systems.

India is Preparing for the Shift

India is investing heavily in the infrastructure needed for the next phase of AI. The IndiaAI Mission has an approved outlay of ₹10,371.92 crore over five years. The government said in August 2026 that more than 45,000 GPUs had been onboarded through its shared computing programme and 237 projects had accessed subsidised capacity. Twenty indigenous foundation-model proposals had also been selected from 506 applications.

AI systems need to work across Indian languages and very different economic and institutional settings. OpenAI announced an India initiative with Tata Group in February covering areas including AI infrastructure and local capability. Google DeepMind has partnered with Indian institutions on applications in science, education, agriculture and energy.

It becomes harder when an AI system spends hours researching, writing code, analysing information and making decisions before presenting a result. The human role will increasingly involve setting the objective, judging evidence and deciding when a system should be trusted. AGI remains undefined, and nobody can put a reliable date on its arrival. But the shift towards more autonomous AI is already visible.

Continue Reading

Technology

India’s AI Moment Rests on More Than Code

India has assembled many of the building blocks of an AI economy: capital, talent, research and startups. But its next phase will depend as much on chips, electricity, skills and policy as on software, exposing the gap between rapid growth and the systems needed to sustain it.

Published

on

featured 4

India’s AI ambitions are now reflected in global rankings, investment flows and Bengaluru’s emergence as a lead ing innovation hub. Yet the numbers reveal only part of the story. Much of the hardware is imported, demand for skilled workers continues to outpace supply, and the infrastructure pow ering AI faces growing pressure. The country’s next challenge is no longer adopting AI, but building the industrial and social foundations that can sus tain its growth.

j2 1

The Hardware Production Gap

The IndiaAI Mission has deployed over 38,000 GPUs and TPUs across domestic data centres. Registered startups and researchers can access this compute at ₹115–150 per GPU hour, roughly 42% cheaper than com mercial cloud rates. The governmentplans to scale this to 100,000 GPUs by December 2026. Not one of these chips is made in India. Every GPU in that stack is sourced from the same export controls that cut China off from this hardware exist as legal authority that could, under different political conditions, apply to India too.

A US India trade framework announced in February this year includes language protecting India’s chip access, but it depends on ongoing political align ment. Budget 2026–27 allocated ₹8,000 crore to the semiconductor and display manufacturing ecosystem programme, the largest single-year outlay since the mission launched, with a separate ₹1,000 crore for India Semiconductor Mission 2.0. The Tata PSMC fabrication plant at Dholera is targeting trial production by late 2026. But these plants are not building AI grade chips.

India’s Sovereign AI

At the IndiaAI Impact Summit 2026, three models were introduced: Sarvam AI, BharatGen, Gnani.ai. BharatGen has assembled over 15,000 hours of annotated voice data across 22 Indian languages. Sarvam’s Vision model, a 3-billion-parameter doc ument intelligence system, scored 84.3% on a standard OCR benchmark, outperforming Google Gemini 3 Pro (80.2%) and OpenAI’s GPT 5.2 (69.8%). Bhashini-v2, launched in early 2026, offers AI-powered translation across all 22 scheduled Indian languages and serves 140 million users on the MyGov platform. India is constructing the language of sovereignty. Indigenous models, na tional compute, and mission branding. But the engine underneath runs on hardware it cannot make and may not always be allowed to import.

The Jobless Economic Growth

India’s IT sector has long been the engine of middle-class stability, con tributing about 7.3% to GDP, employing over 5.8 million people directly, and creating the white-collar jobs that drove spending across housing, edu cation, and retail. That engine is under pressure from the same technology India is racing to lead. Particularly for mid-level coding, BPO, and testing roles that form the bulk of jobs in India. TCS announced 12,000 layoffs in 2025; Infosys and Wipro followed. Across the sector, jobs have been cut in what companies call strategic realignment.

j3 1

NITI Aayog’s October 2025 report projected that in a worst-case sce nario headcount could fall to 6 million by 2031. In April 2026, global equity re search firm Bernstein wrote an open letter to Prime Minister Modi warning that India’s 10 to 15 million IT services, GCC, and BPO workforce faces direct exposure to AI-driven automation. Sonal Varma, chief economist for India and Asia ex-Japan at Nomura, said: “Entry-level routine jobs are being displaced, and mid-level jobs are transforming. India needs to create about 8 million jobs annually.’’

Skill Set for the Emerging Sector

AI DevOps engineers, data centre operators, ethical AI auditors are the major emerging roles. But they require skill sets entirely different from the mass-hiring model that built the IT sector. An IIM-Ahmedabad study found that 68% of white-collar work ers fear automation within five years; 55% have adopted AI tools, but only 48% have received any training. India produces over 1.5 million engineering graduates annually but ranks 18th globally in skills alignment and 73rd in human capital in terms of AI. Graduate volume is not the same as workforce depth.

In that way adoption without re skilling becomes exposure to disrup tion dressed up as progress. NASSCOM projects that the broader AI push could generate 750,000 jobs and add $500 billion in economic value by 2030. Whether they reach the workers being displaced depends on whether India can close the gap between how many people it trains and how well it trains them. It is a gap that every major index in 2026 has documented and none has resolved.

The Climate Bill

There is a cost to India’s AI ambitions that doesn’t appear in invest ment announcements is the physical climate risk accumulating around the infrastructure meant to run it all. A report by climate risk consul tancy assessed 2,595 planned data centres worldwide, examining risks of direct physical damage from climate hazards, operational disruption from extreme heat.

For India, the country ranks 11th globally in physical climate risk to planned data centre infrastruc ture. The more concerning finding is where that risk concentrates. Tamil Nadu, Telangana, and Karnataka, three of India’s major data centre corridors are among the top 30 regions globally for projected operational disruption from extreme heat. South Asia as a whole has one of the highest pro portions of high-risk planned facil ities globally, with risk projected to increase sharply toward the end of the century.

j4 1

Data centres require large-scale cooling to keep servers running. Rising ambient temperatures increase cooling costs, strain electricity grids, and raise the probability of outag es. Countries including India, Brazil, Mexico, Indonesia, and Spain already record some of the highest projected operational disruption risks from heat globally, with more than 75% of anal ysed facilities classified as high risk. Productivity losses become ten times higher with indirect risks like power outages, water shortages, infrastructure failures.

India’s data centre ecosystem is concentrated in heat-exposed regions with al ready-strained urban infrastructure. Future vulnerability can be reduced by adequate planning during site selection, engineering standards, and resilience investment. Microsoft has committed $17.5 billion to Indian data centre expansion. Google is building a hub in Andhra Pradesh with a $15 billion commitment. Amazon has pledged $48 billion through 2030. At this stage, planning choices that are made now determine the risk profile for the next three decades. India has no mandatory national standard governing data centre siting or construction for climate resilience. This gap is no longer a future problem.

Where the Momentum Meets Reality

The 190% growth in Bengaluru’s ecosystem, the indigenous models outperforming global benchmarks, the public compute infrastructure being built at scale are all substantiated achievements. The QS Index gives In dia a perfect score of 100 on economic capacity and ranks it fifth globally in the “Future of Work” category. “The IndiaAI Mission represents substan tive, measurable progress, not merely a policy optics exercise.”

But the gaps are structural. The top ten Indian cities account for nearly half of all AI users while representing less than 10% of the population. The choices being made about who controls the technology, who gets the jobs, who bears the risks will deter mine whether this moment becomes something real or just another set of promises that get quietly shelved. What happens in policy rooms and planning offices will have to answer it.

Continue Reading

Trending