Prompt Caching Explained and How to Cut LLM Costs
Why it matters: Prompt caching can cut LLM input costs by up to 90 percent. See how it works, compare providers, and follow a tested six-step code tutorial today.
Retrieval Augmented Generation vs Fine Tuning
Why it matters: Retrieval augmented generation vs fine tuning: compare cost, accuracy, and privacy, then use our decision framework and scoring tool to pick the right path.
This game-playing AI is the new champ at Stratego
A new AI system that excels at challenging games with hidden information could someday help human decision-makers select ideal strategies to outfox opponents in complicated situations like military maneuvers. Using advances in machine-learning, researchers from MIT, Carnegie Mellon University, New York University, and Stanford University developed an AI that defeated top-ranked human players of the…
MIT Transit Lab to develop an AI platform for public transit agencies
Google.org announced on Sept. 15 that the MIT Transit Lab is a recipient of $2.1 million in funding — one of only 15 projects selected in the worldwide Google.org Impact Challenge: AI for Government Innovation. The funding from Google’s philanthropic arm will support NGOs, social enterprises, and academic institutions as they integrate artificial intelligence-powered solutions across…
Who we become when we talk to machines
Brian, a middle-aged financial consultant, spends his day sitting in front of three screens. Two of them involve his job. The third features a chatbot, which he has given a woman’s name and frequently uses. Brian spent years on the road for work earlier in his career, has never married, and recently broke up with…
The effects of an “algorithmic monoculture” depend on the details
AI tools are increasingly replacing human judgements in some settings. For instance, resume screening algorithms are often used in hiring, where they may improve efficiency and consistency in decision-making. But some scholars have raised concerns that the adoption of automated systems could eventually result in one algorithm being used to make all decisions in a…
New formulation helps RNA vaccines withstand high temperatures
RNA vaccines, which have been proven effective against Covid-19, are now being developed for many other diseases, including cancer. One of the drawbacks to these vaccines is that they require ultracold storage, but researchers from MIT have found a promising way to overcome that limitation. With help from an AI algorithm, the researchers tweaked the…
MIT students gain a humanist lens on technical innovation in Tulsa, Oklahoma
When MIT mechanical engineering student Daphne Wang arrived for her internship at the Muscogee Creek Nation Department of Health in Tulsa, Oklahoma last summer, she expected to be writing code. To her surprise, she found herself analyzing tribal history and the implications for technical innovation. “I learned so much that I think should be required…
Estimating suicide risk from text
When people reach out during a mental health crisis, a top priority for counselors is identifying those with a high risk of suicide. The distressed person’s language holds critical clues, and a new tool developed by scientists at MIT’s McGovern Institute for Brain Research is designed to pick up on and rapidly evaluate those signals….
Deterministic Guardrails for AI Agents
Why it matters: Prompts cannot contain an autonomous agent. See how deterministic guardrails for AI agents enforce tool limits at the gateway, cut risk, and survive an audit.