Inference, not prediction — Prof. Michael I. Jordan on what modern AI is still missing
Analysis of inference, not prediction — prof. michael i. jordan on what modern ai is still missing, based on "Inference, not prediction — Prof. Michael I. Jordan on what modern AI is still missing" | Machine Learning Street Talk.
OPEN SOURCEMichael I. Jordan critiques the anthropomorphizing of AI, arguing it distracts from real issues and demoralizes young innovators. Michael I. Jordan critiques the concept of AGI as a misleading oversimplification of intelligence that detracts from meaningful technological advancements.
Michael I. Jordan argues for an economic perspective in AI, emphasizing the importance of understanding the interactions between agents within markets. Michael I. Jordan argues that AI should be viewed as a collective economic system rather than a pursuit of disembodied superintelligence.


- Michael I. Jordan critiques the tendency to anthropomorphize AI, arguing it diverts attention from critical issues and discourages young innovators eager to make a positive impact
- He describes AGI as a public relations term that can mislead young people, suggesting that alarmist narratives from influential figures may hinder creativity and innovation
- Jordans expertise lies in machine learning, which he believes has practical applications in industries like supply chains and healthcare, overshadowed by the recent hype surrounding AI
- He notes that the current AI buzz is largely driven by advancements in language data processing, creating a false impression that long-standing challenges in AI have been resolved
details
- AGI is criticized as a misleading buzzword that oversimplifies the complexities of intelligence, leading to flawed business models and unrealistic technological expectations
- Michael I. Jordan advocates for a collectivist economic perspective on AI, emphasizing the role of humans as both producers and consumers within these systems
- He challenges the notion that mimicking human intelligence will yield significant advancements, arguing that this approach lacks clear societal goals and deeper intellectual engagement
- Jordan stresses the necessity for actionable mathematical frameworks in AI development, asserting that technology should address collective needs rather than superficial applications
- He cautions against the belief that advanced AI systems will inherently resolve issues, pointing out that many current models primarily enhance existing functionalities without delivering substantial improvements
- Michael I. Jordan advocates for an economic perspective in AI, emphasizing the interactions between agents and the latent cooperation and competition within markets
- He critiques the reductionist view of AI as mere statistical tools, promoting a systems-level understanding that considers the broader ecosystem and the values being generated
- Jordan warns against disruptive technologies that overlook their social implications, particularly regarding mental health and job displacement, calling for a more responsible engineering approach
- He argues that current AI development often lacks deep intellectual engagement, relying on intuitive coding rather than foundational principles found in traditional engineering disciplines
- Jordan highlights the need for technology to create opportunities for work and creativity, rather than simply automating responses or services
- Effective interaction with AI systems prioritizes predictability and actionable outputs over complete mechanistic understanding
- AlphaFold serves as a case study for the necessity of robust statistical testing in AI, as it can generate misleading confidence intervals despite its strong performance
- Jordan advocates for an ecosystem perspective in AI, emphasizing the integration of neural networks into larger systems that require transparency and consideration of interactions
- He critiques the behaviorist approach in AI development, which focuses on output behavior without understanding the underlying mechanisms, potentially leading to critical oversights
- The implications of AI on decision-making processes, especially in sensitive sectors like banking, highlight the importance of understanding the rationale behind AI-generated decisions
- AlphaFold, despite its high accuracy, fails to provide error bars, which are essential for evaluating the reliability of its predictions in new scientific contexts
- The concept of prediction-powered inference is proposed as a method to combine ground truth data with existing models, enhancing the reliability of predictions
- Jordan highlights that current foundation models, such as AlphaFold, may exhibit biases when addressing new scientific questions, underscoring the need for frameworks that incorporate real-world data to refine their outputs
- He cautions against anthropomorphizing AI systems, arguing that effective operation does not require understanding or intelligence, but rather a focus on predictive capabilities and the surrounding systems
- The practical application of machine learning in complex systems, like supply chain management, prioritizes accurate predictions and optimizations over a deep understanding of underlying processes
details
details
details
- Understanding complex systems should prioritize reconstructing perspectives over rigid definitions, blending creativity with empirical testing
- Innovation often relies on trial and error, exemplified by Dick Fosburys backward high jump technique, which transformed the sport
- In drug discovery, the relationship between pharmaceutical companies and regulatory agencies creates a complex system where economic incentives can impact data integrity and decision-making
- Regulatory agencies face challenges in managing the self-interested motivations of pharmaceutical companies to reduce false positives and negatives in drug testing, necessitating a statistical and economic approach
- The need for clear goal-setting in system design, questioning whether the objective is to replace or enhance human roles and how to effectively achieve those aims
- The significance of economic incentives in drug discovery, emphasizing the need for pharmaceutical companies to be motivated to provide reliable data rather than arbitrary results
- A proposed three-layer data market model illustrates how user data is collected by platforms and sold to third parties, raising privacy concerns and altering the systems equilibrium
- Effective economic systems should adapt to user privacy concerns by allowing customizable levels of data sharing, rather than relying solely on regulatory intervention
- The conversation critiques the belief that large language models (LLMs) will dominate decision-making, arguing that local data and microeconomic perspectives will be more influential in future interactions
- A differential privacy model in data markets allows users to select their privacy level at a cost, influencing the datas value to buyers
- Conflicting incentives in data markets arise as higher privacy levels diminish data value, necessitating complex mathematical modeling to optimize social welfare
- Integrating economics with machine learning is essential, as traditional economic models often lack the data-driven insights provided by machine learning, which must also account for equilibrium dynamics
- The speaker challenges the assumption that large datasets automatically yield behavioral insights, advocating for a deeper understanding of social knowledge and its transient nature
- A call for humility in data-driven decision-making emphasizes the limitations of predictive capabilities and the need for safe, adaptive systems that can evolve over time
details
- The conversation highlights the need for bottom-up systems that reflect human preferences, contrasting with top-down approaches that assume a singular understanding of values
- AlphaFolds limitations illustrate that large datasets cannot capture the nuanced details necessary for effective decision-making, particularly in uncertain scenarios
- Markets are viewed as natural phenomena that existed before capitalism, emphasizing the importance of systems that foster the emergence of new knowledge and cultural abstractions
- The discussion critiques Silicon Valleys focus on macro-level trends, arguing that understanding micro-level dynamics of knowledge creation and cultural adaptability is vital for effective AI development
- The role of organizations in fostering beneficial knowledge and practices is emphasized, suggesting that insights into behavioral organization are essential for the evolution of AI ecosystems
- Michael I. Jordan critiques tech companies business models, particularly those of Spotify and Google, for prioritizing profit over fair compensation for creators, which he believes leads to monopolistic practices detrimental to artists
- He advocates for economic systems that directly reward artists, arguing that current platforms often extract most of the value, undermining the producer-consumer relationship
- Jordan expresses concern that the portrayal of AI as a self-improving technology by prominent figures is misleading and demoralizing for young innovators eager to make positive contributions to society
- He argues that the prevailing narrative around AI is overly focused on cognitive science and lacks economic considerations, potentially discouraging young builders from pursuing meaningful technological advancements
- Michael I. Jordan critiques the concept of superintelligence, advocating for AI that enhances human capabilities instead of replacing them
- He highlights the limitations of current AI systems, which do not accurately reflect human intelligence despite their effectiveness in specific tasks
- Jordan raises concerns about the societal impact of AI on labor and capital dynamics, warning that technology could worsen existing inequalities
- He argues that the portrayal of AI as a self-improving technology is misleading, potentially discouraging young innovators who fear negative consequences
- Jordan calls for a more nuanced perspective on AI, emphasizing its role in supporting human decision-making rather than supplanting human judgment
- Michael I. Jordan argues that AI should enhance human capabilities rather than replace them, highlighting that current discussions often misrepresent its potential and risks
- He critiques the binary narrative of superintelligence versus extinction, advocating for constructive AI development that focuses on improving human systems
- Jordan promotes a hybrid approach to AI, where automation supports human decision-making, as exemplified in aviation, rather than relying solely on autonomous systems
- He expresses concern about the polarized dialogue in the tech community, where some exploit AI for profit while others fear its implications without recognizing its benefits
- Jordan calls for a shift in focus towards creating systems that tackle real-world challenges, especially in areas where human decision-making is flawed
- Michael I. Jordan critiques the AI landscape, arguing that many initiatives are disconnected from practical applications and overly influenced by unrealistic science fiction narratives
- He underscores the importance of mechanism design in economics, which aims to create systems that achieve specific outcomes, in contrast to traditional game theory that focuses on predicting outcomes
- Jordan emphasizes the need for uncertainty quantification in machine learning, highlighting conformal prediction as a crucial method for assessing uncertainty and guiding decision-making
- He notes that the field of game theory is dynamic and offers valuable algorithmic insights for managing decision-making and uncertainty across various applications
- Jordan expresses concern over the immaturity of some AI approaches, where significant investments are made without clear objectives, raising questions about the future direction of research and development
details
- E-values provide a novel statistical method for anytime inference, allowing researchers to draw conclusions from data while avoiding issues associated with traditional p-values, such as p-hacking
- The interplay between game theory and statistical contract theory illustrates how statistical evidence can shape economic incentive structures, revealing a significant connection between these disciplines
- Jordan advocates for a comprehensive approach that combines inferential, economic, and computational thinking to enhance problem-solving frameworks and training for future researchers
- He critiques traditional statistics for its limited focus on error bars, urging a more expansive view of uncertainty quantification that incorporates the context of contracts and evidence-gathering mechanisms
- Michael I. Jordan critiques modern AI, particularly language models, for their inadequate understanding of uncertainty and context, which hampers their effectiveness compared to human reasoning
- He uses the example of ducks selecting sides of a lake based on grain availability to illustrate that real-world decision-making involves cooperation and hedging, aspects that AI models struggle to emulate
- Jordan emphasizes the importance of provenance and metadata in data analysis, arguing that neglecting these elements leads to insufficient uncertainty quantification in AI systems
- He advocates for a new academic framework that merges economics, computer science, and statistics, promoting a holistic approach to problem-solving that considers societal responsibilities
- Jordan stresses the necessity for AI systems to integrate broader contexts and uncertainties, mirroring human cognitive processes to enhance their decision-making capabilities
- Current AI models, especially language models, often lack true understanding of uncertainty, leading to superficial reasoning that mimics human assertions without genuine epistemic insight
- Epistemic quantification is essential for enhancing AIs ability to identify knowledge gaps and pursue additional information, similar to traditional statistical approaches that prioritize uncertainty reduction
- Markets are vital in reducing uncertainty by providing stable resources, enabling businesses to function with greater confidence rather than relying solely on optimal experimental designs
- Professor Jordan highlights that effective inference necessitates a comprehensive understanding of uncertainty, which includes integrating market dynamics and social interactions
The assumption that AGI represents a significant leap in AI capabilities overlooks the complexities of machine learning's historical context and its real-world applications. Inference: This framing may mislead young innovators into believing that their contributions are futile, thus stifling creativity. The lack of economic thinking in current narratives fails to address the systemic issues in data usage and the potential for innovation.
This analysis is an original interpretation prepared by Art Argentum based on the transcript of the source video. The original video content remains the property of the respective YouTube channel. Art Argentum is not responsible for the accuracy or intent of the original material.