Connect with us

Society

Here’s a technique to assess the reliability of AI models before it’s deployed

“All models can be wrong, but models that know when they are wrong are more useful.”

Published

on

Credits :MIT News; Courtesy of the researchers

MIT researchers, together with the MIT-IBM Watson AI Lab, have designed a method to assess the dependability of foundational AI models prior to their deployment in specific tasks.

Their method involves analyzing a set of slightly varied models and evaluating how consistently each model learns representations of the same test data point. Consistent representations indicate a reliable model.

This technique offers significant practical implications. It enables decision-makers to determine whether a AI model is suitable for deployment in specific settings without the necessity of testing it on real-world datasets

When compared against current advanced methods, their technique outperformed others in accurately measuring the reliability of foundation models across various downstream classification tasks.

This technique offers significant practical implications. It enables decision-makers to determine whether a AI model is suitable for deployment in specific settings without the necessity of testing it on real-world datasets. This capability is particularly valuable in contexts where accessing datasets is restricted due to privacy concerns, such as in healthcare settings. Furthermore, the method facilitates the ranking of models based on their reliability scores, empowering users to select the most appropriate model for their intended task.

Navid Azizan, senior author of the study and Esther and Harold E. Edgerton Assistant Professor in the MIT Department of Mechanical Engineering and the Institute for Data, Systems, and Society (IDSS), highlights the importance of models being aware of their own limitations: “All models can be wrong, but models that know when they are wrong are more useful.” He emphasizes the challenge in quantifying uncertainty or reliability for foundation models due to their abstract representations, which are inherently difficult to compare. Azizan concludes that their method offers a means to precisely quantify how reliable a model’s representation is for any given input data.

The research paper, authored by Young-Jin Park, a graduate student at LIDS; Hao Wang, a research scientist at the MIT-IBM Watson AI Lab; and Shervin Ardeshir, a senior research scientist at Netflix, will be presented at the Conference on Uncertainty in Artificial Intelligence.

Traditional machine-learning models are typically trained for specific tasks, providing definite predictions based on inputs such as determining whether an image features a cat or a dog. In contrast, foundation models are pretrained on generalized data without prior knowledge of the diverse tasks they will eventually tackle. Users fine-tune these models for specific applications after their initial training.

Unlike conventional models that yield straightforward outputs like “cat” or “dog,” foundation models generate abstract representations based on input data. Evaluating the reliability of such models poses a unique challenge. Researchers adopted an ensemble approach by training multiple models with similar characteristics but slight variations.

“Our concept is akin to gauging consensus. If all these foundation models consistently produce similar representations for any given dataset, then we can infer the model’s reliability,” explains Park.

The challenge arose in comparing these abstract representations. He says that these models output vectors, composed of numerical values, making direct comparisons difficult. The solution involved employing a method known as neighborhood consistency.

In their methodology, researchers established a set of dependable reference points to test across the ensemble of models. They examined neighboring points surrounding each model’s representation of the test data point to gauge consistency.

By assessing the coherence among neighboring points, they could effectively estimate the reliability of the models.

Health

IITK Researchers Unveils Key Receptor Structure for Cancer and Respiratory Treatments

The team successfully visualized the atomic structure of CXCR2, a crucial human receptor involved in the progression of cancer and respiratory diseases

Published

on

GPCR Lab. Image credit: By special arrangement

Researchers from the Department of Biological Sciences and Bioengineering at the Indian Institute of Technology (IIT) Kanpur have made a path breaking discovery that could pave the way for new treatments for cancer and respiratory diseases. The team successfully visualized the atomic structure of CXCR2, a crucial human receptor involved in the progression of these diseases. Their findings, published in the prestigious journal Molecular Cell, offer a new perspective on targeting this receptor for therapeutic intervention.

CXCR2 is a key receptor in the immune system, involved in directing immune cells to infection and injury sites through interaction with chemokines—small signaling proteins. CXCR2’s role in inflammatory disorders and cancers such as chronic obstructive pulmonary disease (COPD), asthma, atherosclerosis, and pancreatic cancer makes it a promising target for new drugs.

Using advanced cryogenic-electron microscopy (cryo-EM), the IIT Kanpur researchers captured unprecedented details of the receptor’s “lock-and-key” mechanism, shedding light on how CXCR2 interacts with multiple chemokines. This discovery addresses a fundamental question in biomedical science about how a single receptor can bind to various chemokines and trigger biological responses. The visualization also opens up opportunities for designing novel therapeutics.

“Our findings provide a molecular blueprint for designing next-generation therapeutics that can precisely target CXCR2 and potentially reduce its role in cancer and respiratory diseases. By visualizing this receptor in its active state, we now have the opportunity to develop highly specific inhibitors that can disrupt its function, potentially leading to significant advancements in treatment strategies,” said Professor Arun Kumar Shukla, the lead investigator of the study at IIT Kanpur.

The research team at IIT Kanpur includes Shirsha Saha, Saloni Sharma, Manisankar Ganguly, Nashrah Zaidi, Divyanshu Tiwari, Nabarun Roy, Nilanjana Banerjee, and Ramanuj Banerjee. Their work also involved collaboration with experts from the University of Tokyo, Japan—Fumiya Sano, Hiroaki Akasaka, Takaaki Kobayashi, Yuzuru Itoh, Wataru Shihoya, and Osamu Nureki—along with Andy Chevigne from the Luxembourg Institute of Health.

This study was funded by the DBT Wellcome Trust India Alliance, Science and Engineering Research Board (SERB), Indian Council of Medical Research (ICMR), and LADY TATA Memorial Trust.

Building on this discovery, the IIT Kanpur team is now developing small molecules and antibodies aimed at targeting CXCR2. These therapeutics will undergo laboratory testing, followed by animal studies, bringing the team closer to offering innovative treatments for cancer and respiratory diseases. This achievement further underscores IIT Kanpur’s commitment to pioneering research that has the potential to revolutionize global healthcare and biomedical innovation.

Continue Reading

Society

Is India’s Clean Cooking Gas Model the Future for the Global South?

The Indian model, backed by smart subsidies and sustainable policies, provides a scalable solution for developing nations striving for clean cooking access

Published

on

Image by Aristal Branson from Pixabay

At the just concluded India Energy Week 2025 (February 11-14), India’s Union Minister of Petroleum and Natural Gas, Hardeep Singh Puri, chaired a Ministerial Roundtable on Clean Cooking, where India’s success in providing universal access to clean cooking gas became a key focal point. The Minister emphasized that India’s model for clean cooking gas is not only a success story but also a replicable blueprint for the Global South, offering solutions to nations facing similar energy access challenges.

“India’s clean cooking gas revolution is a game-changer,” said Puri. He pointed out the key factors behind this success: targeted subsidies, strong political will, the digitization of distribution networks by Oil Marketing Companies (OMCs), and nationwide campaigns to shift cultural practices towards clean cooking.

The session brought together representatives from Brazil, Tanzania, Malawi, Sudan, Nepal, and key industry leaders, including the International Energy Agency (IEA), Total Energy, and Boston Consulting Group (BCG). These nations, all striving to enhance energy access for their populations, were eager to learn from India’s achievements.

Under India’s popular government scheme Pradhan Mantri Ujjwala Yojana (PMUY– Prime Minister’s Lightening Scheme), beneficiaries receive LPG access at a highly affordable cost of just 7 cents per day, while other consumers can access clean cooking fuel at 15 cents per day. “This affordability has been a game-changer in driving widespread adoption,” added Shri Puri, underlining the pivotal role of subsidies in overcoming financial barriers to clean cooking.

International representatives shared their nations’ efforts to transition to clean cooking solutions. Dkt. Doto Mashaka Biteko, Deputy Prime Minister and Minister of Energy of Tanzania, outlined the country’s strategy to transition 80% of households to clean cooking by 2030, relying on subsidies and a mix of energy sources, including LPG, natural gas, and biogas. Despite this ambition, he noted challenges such as financing constraints, infrastructure costs, and the need for regulatory reforms to encourage private-sector participation.

Similarly, Dr. Mohieldien Naiem Mohamed Saied, Minister of Energy and Oil, Sudan, emphasized the need for private-sector involvement to overcome gaps in LPG supply, particularly as Sudan still imports much of its energy. He stressed the importance of encouraging local cylinder production and ensuring cost-effective imports to drive broader adoption.

Mary Burce Warlick, Deputy Executive Director of the IEA, recognized India’s success as a model that offers valuable lessons for other nations grappling with issues of affordability, access, and infrastructure. She emphasized the role of concessional financing and public-private partnerships (PPP) in scaling up clean cooking access. Addressing cultural acceptance and regulatory adjustments, such as tax reductions, were also highlighted as critical factors for large-scale adoption.

Rahool Panandiker, Partner at Boston Consulting Group (BCG), further underscored the effectiveness of India’s clean cooking transformation. He attributed the success to the strong political commitment, effective subsidy targeting, and robust public awareness campaigns. Panandiker also credited India’s Oil Marketing Companies (OMCs) for enabling last-mile LPG delivery through digital platforms, making adoption seamless. He also stressed the importance of refining the cylinder refill model to ensure sustained usage while balancing affordability with economic sustainability.

In addition to LPG, the roundtable explored the potential of alternative clean cooking technologies. Puri addressed the potential of solar cookers in expanding clean cooking solutions across the Global South. He highlighted that IOCL’s advanced solar cookers, priced at approximately $500 per unit, could be a viable solution, though the price point remains a challenge for widespread adoption. “Leveraging carbon financing and collaborating with the private sector can drive costs down and make solar cooking a viable alternative for millions,” he stated.

This initiative aligns with India’s broader efforts to diversify clean cooking options beyond LPG, further reinforcing its commitment to reducing reliance on traditional biomass fuels and cutting carbon emissions. The government’s focus on solar cooking options aims to ensure a more sustainable future for energy access, particularly in remote and underserved areas.

“The Indian model, backed by smart subsidies and sustainable policies, provides a scalable solution for developing nations striving for clean cooking access,” Puri said. He also stressed that achieving universal clean cooking access is not merely an economic imperative but a moral one, given the severe health and environmental impacts of traditional biomass cooking.

Continue Reading

Green Energy

India Strengthens Clean Energy Initiatives at India Energy Week 2025

These clean energy projects are part of India’s broader strategy to diversify its energy sources and strengthen its energy security while promoting sustainability

Published

on

Image credit: PIB

At the India Energy Week 2025, India underscored its commitment to a sustainable and clean energy future through several strategic partnerships and agreements. Minister of Petroleum and Natural Gas, Hardeep Singh Puri, highlighted the importance of these initiatives in driving India’s transition to a greener energy landscape.

A key development in the clean energy sector was the partnership between India’s public sector firm BPCL and Eco Wave Power of Israel, which aims to establish India’s first wave energy pilot project in Mumbai. The project will utilize wave energy converter technology, marking a significant step in the country’s exploration of renewable energy sources.

In the biofuel sector, BPCL also signed an MoU with the National Sugar Institute, Kanpur, to scale up the production of sweet sorghum-based bioethanol. This collaboration will help build capacity for both farmers and industry partners, supporting India’s drive to increase the share of biofuels in its energy mix.

These clean energy projects are part of India’s broader strategy to diversify its energy sources and strengthen its energy security while promoting sustainability. Through these initiatives, India is reinforcing its position as a key player in the global clean energy transition.

Minister Puri emphasized that these agreements are a testament to India’s commitment to securing affordable, sustainable energy and fostering international collaborations in cutting-edge energy solutions. These partnerships will help achieve India’s energy transition goals, ensuring a resilient and sustainable energy future for the nation.

Continue Reading

Trending