Dr. Vivek Deulkar https://vivekdeulkar.github.io/blog/ quarto-1.7.31 Wed, 28 May 2025 18:30:00 GMT The History of Artificial Intelligence Vishal Paudel https://vivekdeulkar.github.io/blog/posts/history-of-ai/ Attempting to systematically study the history of any human endeavour is an intellectual hurdle which hides in it a humoungous potential and bears through it a sweet fruit of truth. Such an activity bears flexibility of thought, it sows seeds for lays bare detailed insights and more than any other benefit, it gives strength. But this activity is difficult. To attempt a study of a subject’s evolution is difficult. This more than any other subject, is more so the case with Artificial Intelligence which by its nature spans and crosses so many disciplines that in my opinion no other subject pursuid by humans does. The reason for this is clear. Artificial Intelligence begins at the inate experience of every human being. It starts with that hopelessness of reasoning the experienced reality and ends today at the most colourful intersection of most advanced of human technologies. It crosses border between disciplines, by approach from nueroscience, philosophy and in application from mathematics to biology. Thus it is a tremendous task to attempt studying the history of such an intricate subject. Am I attempting to do such a thing? I do not know. Right now not. Right now, the following document only contains the most curious of happenstances and outlines the outline of the developments of a Giant of a human endeavour. Right now, the following documents only contains an Outline of the evolution of the field of Artificial Intelligence.

Outline Summary

The current outline is mostly a product of my reaserach of the topic of this article(?). Most of the inspiration for this outline right now, comes from [the-wikipedia-article] on this subject. The AIM of this currently is to be comprehensive and historically accurate foundation for an eventual article(?) on AI history.

Brief Remarks on the Outline

Key Decisions Made:

  1. Precursors Section: The structure from [the-wikipedia-article] revealed I had underemphasized the rich mythological and fictional foundations of AI. So, I have updated outline now with ancient myths (Greek Talos, Jewish Golem), medieval legends, and modern fiction that shaped AI imagination.

  2. Periodization: [the-wikipedia-article] refined the chronology of the Outline. The “Birth of AI” period (1941-1956) now properly includes wartime computing advances, and I’ve separated the later periods more clearly.

  3. Institutional Context: The details from [the-lesswrong-blog]. I have added more sections about specific research centers and their approaches (Stanford logic, MIT anti-logic, Edinburgh), which provides important context for understanding how different AI schools of thought developed.

  4. Market and Commercial Aspects: [the-wikipedia-article] emphasizes the commercial dimension thourougly. I’ve now included in the outline sections for details about AI companies, market cycles, and the business side of AI development.

  5. Recent Recognition: I’ve added a section on 2024 Nobel Prizes - it shows AI’s achievement of scientific respectability and recognition at the highest levels.

Structural Decisions Worth Noting:

  • Wikipedia uses broader periods with more overlap, while my original outline was more strictly chronological
  • Wikipedia emphasizes the cyclical nature of AI development (winters and booms) more explicitly
  • The Wikipedia structure shows how AI “went behind the scenes” during winters, continuing to develop within other fields
  • Recent developments are given more weight, reflecting AI’s current prominence

Depth vs Breadth Trade-offs:

Right now, the outline maintains more technical depth in areas like specific algorithms and theoretical foundations, while [the-wikipedia-article] structure is more accessible to general readers. For the article, I am considering audience targeting to decide on the appropriate level of technical detail for each section.

Finally here is the Outline:

1 Introduction

1.1 What is Artificial Intelligence?

1.1.1 Defining intelligence in machines

1.1.2 The Turing Test and early benchmarks

1.1.3 Narrow vs General AI distinction

1.2 Why Study AI History?

1.2.1 Understanding current limitations and capabilities

1.2.2 Learning from past hype cycles and winters

1.2.3 Appreciating the interdisciplinary nature of AI development

2 Precursors (Ancient Times - 1940s)

2.1 Mythical, Fictional, and Speculative Precursors

2.1.1 Ancient myths and legends of artificial beings

2.1.1.1 Greek myths: Talos, Pandora, Pygmalion’s Galatea

2.1.1.2 Jewish folklore: the Golem of Prague

2.1.1.3 Hindu and Buddhist automata in religious texts

2.1.2 Medieval legends of artificial beings

2.1.2.1 Albertus Magnus and Thomas Aquinas’s brazen heads

2.1.2.2 Mechanical servants in Islamic Golden Age literature

2.1.2.3 European clockwork automata and mechanical marvels

2.1.3 Modern fiction and speculative thought

2.1.3.1 Mary Shelley’s Frankenstein (1818)

2.1.3.2 Karel Čapek’s R.U.R. and the word “robot” (1920)

2.1.3.3 Isaac Asimov’s robot stories and Three Laws

2.2 Historical Automata

2.2.1 Ancient and medieval mechanical devices

2.2.1.1 Antikythera mechanism and ancient Greek engineering

2.2.1.2 Al-Jazari’s programmable automata (13th century)

2.2.1.3 European cathedral clocks and moving figures

2.2.2 Renaissance and Enlightenment automata

2.2.2.1 Vaucanson’s mechanical duck and flute player

2.2.2.2 Jaquet-Droz family’s writing and drawing automata

2.2.2.3 The Turk: Kempelen’s chess-playing automaton hoax

2.3 Formal Reasoning Foundations

2.3.1 Aristotelian logic and syllogistic reasoning

2.3.2 Medieval scholastic logic developments

2.3.3 Leibniz’s dream of universal reasoning and characteristica universalis

2.3.4 Boolean algebra and the algebra of logic

2.3.5 Frege’s predicate logic and formal systems

2.4 Mathematical and Computational Prerequisites

2.4.1 Gödel’s incompleteness theorems and limits of formal systems

2.4.2 Church-Turing thesis and computability theory

2.4.3 Shannon’s information theory and switching circuits

2.4.4 Early mechanical calculators: Pascal, Leibniz, Babbage

2.4.5 Ada Lovelace’s insights on machine capabilities

3 Birth of Artificial Intelligence (1941-1956)

3.1 Wartime Computing Innovations

3.1.1 Colossus and early electronic computers

3.1.2 Cybernetics and feedback control systems

3.1.3 Claude Shannon’s information theory foundations

3.2 The Turing Test and Machine Intelligence

3.2.1 Turing’s “Computing Machinery and Intelligence” (1950)

3.2.2 The imitation game and operational definitions of intelligence

3.2.3 Early philosophical debates about machine consciousness

3.3 Neuroscience and Hebbian Learning Theory

3.3.1 Donald Hebb’s “The Organization of Behavior” (1949)

3.3.2 Neural plasticity and learning mechanisms

3.3.3 Bridge between neuroscience and artificial systems

3.4 Early Artificial Neural Networks

3.4.1 McCulloch-Pitts neuron model (1943)

3.4.2 Mathematical foundations of neural computation

3.4.3 Perceptron development and early learning algorithms

3.5 Cybernetic Robots and Control Systems

3.5.1 Grey Walter’s autonomous robots (Elmer and Elsie)

3.5.2 Feedback control and homeostatic machines

3.5.3 Early robotics and autonomous behavior

3.6 Game AI and Strategic Thinking

3.6.1 Shannon’s chess-playing algorithms

3.6.2 Arthur Samuel’s checkers program

3.6.3 Game theory applications to machine decision-making

3.7 Symbolic Reasoning and the Logic Theorist

3.7.1 Newell and Simon’s Logic Theorist program (1956)

3.7.2 Symbolic manipulation and theorem proving

3.7.3 General Problem Solver architecture

3.8 The Dartmouth Workshop (1956)

3.8.1 John McCarthy coins “Artificial Intelligence”

3.8.2 Key participants and their research agendas

3.8.3 Birth of AI as a formal academic discipline

3.8.4 Initial optimism and ambitious goals

3.9 The Cognitive Revolution Context

3.9.1 Shift from behaviorism to information processing

3.9.2 Computer metaphors for human cognition

3.9.3 Interdisciplinary collaboration emergence

4 Early Successes (1956-1974)

4.1 Major Approaches and Methodologies

4.1.2 Natural language processing attempts

4.1.2.1 ELIZA and pattern matching approaches

4.1.2.2 Syntactic parsing and grammar systems

4.1.2.3 Early machine translation projects and failures

4.1.3 Micro-worlds and constrained domains

4.1.3.1 Blocks World and spatial reasoning

4.1.3.2 SHRDLU and natural language understanding

4.1.3.3 Simplified domains for complex reasoning

4.1.4 Perceptrons and early neural networks

4.1.4.1 Rosenblatt’s perceptron learning algorithm

4.1.4.2 Pattern recognition capabilities

4.1.4.3 Minsky-Papert critique and limitations

4.2 Unbounded Optimism Period

4.2.1 Predictions of rapid progress to human-level AI

4.2.2 Herbert Simon’s famous 1957 prediction

4.2.3 Marvin Minsky’s timeline estimates

4.2.4 Media coverage and public excitement

4.3 Research Financing and Institutional Growth

4.3.1 DARPA (ARPA) funding initiatives

4.3.2 University AI labs establishment

4.3.3 Government interest in machine translation

4.3.4 Private sector early investments

4.4 Key Figures and Their Contributions

4.4.1 John McCarthy: LISP, time-sharing, logic formalization

4.4.2 Marvin Minsky: neural networks, Society of Mind concepts

4.4.3 Allen Newell and Herbert Simon: problem-solving paradigms

4.4.4 Arthur Samuel: machine learning and self-improvement

4.4.5 Joseph Weizenbaum: ELIZA and human-computer interaction

5 First AI Winter (1974-1980)

5.1 Fundamental Problems Emerge

5.1.1 Combinatorial explosion in search problems

5.1.2 Frame problem in knowledge representation

5.1.3 Brittleness of symbolic reasoning systems

5.1.4 Scaling challenges with real-world complexity

5.2 Dramatic Decrease in Funding

5.2.1 Lighthill Report’s devastating critique (UK, 1973)

5.2.2 DARPA funding cuts in the United States

5.2.3 Machine translation projects declared failures

5.2.4 University lab closures and staff reductions

5.3 Philosophical and Ethical Critiques

5.3.1 Hubert Dreyfus’s “What Computers Can’t Do”

5.3.2 Critique of symbol manipulation approaches

5.3.3 Questions about embodied intelligence

5.3.4 Ethical concerns about replacing human judgment

5.4 Institutional Responses and Adaptations

5.4.1 Logic programming at Stanford, CMU, and Edinburgh

5.4.1.1 Prolog development and logic-based reasoning

5.4.1.2 Resolution theorem proving advances

5.4.1.3 Formal verification research

5.4.2 MIT’s “anti-logic” approach

5.4.2.1 Emphasis on procedural knowledge

5.4.2.2 Frame-based knowledge representation

5.4.2.3 Commonsense reasoning research

5.5 Lessons and Methodological Shifts

5.5.1 Importance of realistic goal-setting

5.5.2 Need for rigorous evaluation metrics

5.5.3 Value of incremental over revolutionary progress

5.5.4 Recognition of knowledge acquisition bottleneck

6 AI Boom (1980-1987)

6.1 Expert Systems Become Widely Used

6.1.1 DENDRAL and MYCIN success stories

6.1.2 Commercial expert system shells

6.1.3 Rule-based reasoning in industry applications

6.1.4 Knowledge engineering methodology development

6.2 Government Funding Increases

6.2.1 Japanese Fifth Generation Computer Systems project

6.2.2 US Strategic Computing Initiative response

6.2.3 European ESPRIT program investments

6.2.4 Military AI applications funding

6.3 The Knowledge Revolution

6.3.1 Knowledge-based systems paradigm

6.3.2 Ontology development and knowledge representation

6.3.3 Inference engines and explanation facilities

6.3.4 Expert system development tools and environments

6.4 Commercial AI Market Expansion

6.4.1 AI companies go public: Symbolics, LMI, IntelliCorp

6.4.2 Lisp machine specialized hardware

6.4.3 Expert system consulting boom

6.4.4 Corporate AI research labs establishment

6.5 New Directions in the 1980s

6.5.1 Revival of neural networks: “connectionism”

6.5.1.1 Parallel distributed processing (PDP) volumes

6.5.1.2 Backpropagation algorithm rediscovery

6.5.1.3 Neural network hardware development

6.5.1.4 Connectionist vs symbolic AI debates

6.5.2 Robotics and embodied reasoning

6.5.2.1 Mobile robot navigation systems

6.5.2.2 Computer vision for robotics

6.5.2.3 Sensor fusion and real-world interaction

6.5.2.4 Behavior-based robotics emergence

6.5.3 Soft computing and probabilistic reasoning

6.5.3.1 Fuzzy logic systems development

6.5.3.2 Uncertainty handling in expert systems

6.5.3.3 Probabilistic inference methods

6.5.3.4 Hybrid symbolic-numeric approaches

6.5.4 Reinforcement learning foundations

6.5.4.1 Temporal difference learning

6.5.4.2 Q-learning algorithm development

6.5.4.3 Markov decision process formalization

6.5.4.4 Learning from interaction paradigms

7 Second AI Winter (1987-1993)

7.1 AI Winter Market Collapse

7.1.1 Lisp machine companies bankruptcy

7.1.2 Expert systems market crash and disillusionment

7.1.3 End of Japanese Fifth Generation project

7.1.4 Venture capital withdrawal from AI sector

7.2 Technical Limitations Exposed

7.2.1 Scaling problems with symbolic approaches

7.2.2 Knowledge acquisition bottleneck persists

7.2.3 Brittleness in real-world applications

7.2.4 Maintenance costs exceed benefits

7.3 AI Research Goes Behind the Scenes

7.3.1 Integration into other computer science fields

7.3.2 Gradual embedding in practical applications

7.3.3 Less visible but continued progress

7.3.4 Focus shifts from AI as brand to useful techniques

7.4 Mathematical Rigor and Methodological Changes

7.4.1 Greater emphasis on statistical methods

7.4.2 Rigorous evaluation protocols development

7.4.3 Collaboration with statistics and optimization

7.4.4 Move away from grand unified theories

7.5 Narrow Focus and Specialized Applications

7.5.1 Constraint satisfaction problems

7.5.2 Automated reasoning in specific domains

7.5.3 Machine learning for particular tasks

7.5.4 Computer vision for industrial applications

7.6 Intelligent Agents Paradigm Emergence

7.6.1 Agent-oriented programming concepts

7.6.2 Distributed problem solving

7.6.3 Multi-agent systems research

7.6.4 Software agents and autonomous systems

7.7 Milestones Despite the Winter

7.7.1 Continued progress in specialized areas

7.7.2 Moore’s Law enabling new possibilities

7.7.3 Internet creating new data sources

7.7.4 Gradual accumulation of practical successes

8 Big Data, Deep Learning, and AGI Research (2005-2017)

8.1 Big Data and Computational Revolution

8.1.1 Internet-scale datasets emergence

8.1.2 Cloud computing democratization

8.1.3 GPU computing for parallel processing

8.1.4 Distributed computing frameworks (MapReduce, Hadoop)

8.2 Deep Learning Breakthrough

8.2.1 Geoffrey Hinton’s deep belief networks

8.2.2 ImageNet competition and convolutional networks

8.2.3 Backpropagation scaling to deeper networks

8.2.4 Representation learning and feature discovery

8.3 The Alignment Problem Recognition

8.3.1 AI safety research emergence

8.3.2 Control problem and value alignment

8.3.3 Long-term existential risk discussions

8.3.4 Stuart Russell and Nick Bostrom’s contributions

8.4 Artificial General Intelligence Research

8.4.1 AGI as explicit research goal

8.4.2 OpenAI and DeepMind founding

8.4.3 Different approaches to general intelligence

8.4.4 Debate over timelines and feasibility

8.5 Major Milestones and Achievements

8.5.1 Deep Blue defeats Kasparov (1997)

8.5.2 Watson wins Jeopardy! (2011)

8.5.3 AlexNet ImageNet victory (2012)

8.5.4 AlphaGo defeats world champion (2016)

8.6 Industry Transformation

8.6.1 Big Tech AI arms race begins

8.6.2 Acquisition of AI startups and talent

8.6.3 Open source framework development

8.6.4 AI democratization through cloud services

9 Large Language Models and AI Boom (2020-Present)

9.1 Transformer Architecture and Language Models

9.1.1 “Attention is All You Need” paper impact

9.1.2 BERT and bidirectional representations

9.1.3 GPT series evolution and scale effects

9.1.4 Parameter scaling and emergent capabilities

9.2 The AI Boom Acceleration

9.2.1 ChatGPT release and mainstream adoption

9.2.2 Generative AI investment surge

9.2.3 Competition between tech giants

9.2.4 AI startup ecosystem explosion

9.3 Advent of AI for Public Use

9.3.1 User-friendly AI interfaces

9.3.2 Democratization of AI capabilities

9.3.3 Integration into everyday applications

9.3.4 Consumer and enterprise adoption

9.4 2024 Nobel Prizes Recognition

9.4.1 Geoffrey Hinton and John Hopfield (Physics)

9.4.2 Demis Hassabis, John Jumper, David Baker (Chemistry)

9.4.3 AI’s contribution to scientific discovery

9.4.4 Recognition of AI’s fundamental importance

9.5 Current Developments and Challenges

9.5.1 Multimodal AI systems (vision, text, audio)

9.5.2 AI safety and alignment research intensification

9.5.3 Regulatory frameworks development

9.5.4 Societal impact and adaptation

9.5.5 Artificial General Intelligence pursuit

9.5.6 Compute scaling and efficiency improvements

10 Current Frontiers and Future Directions

10.1 Technical Challenges

10.1.1 Artificial General Intelligence (AGI) pursuit

10.1.2 Causal reasoning and world models

10.1.3 Continual learning and catastrophic forgetting

10.1.4 Embodied AI and robotics integration

10.2 Emerging Paradigms

10.2.1 Neuro-symbolic AI hybrid approaches

10.2.2 Quantum computing applications

10.2.3 Brain-computer interfaces

10.2.4 Neuromorphic computing architectures

10.3 Societal Considerations

10.3.1 AI governance and international cooperation

10.3.2 Economic disruption and job displacement

10.3.3 Privacy and surveillance implications

10.3.4 Democratic participation in AI development

11 Lessons from AI History

11.1 Recurring Patterns

11.1.1 Hype cycles and their predictable stages

11.1.2 Importance of hardware-software co-evolution

11.1.3 Value of interdisciplinary collaboration

11.1.4 Role of data availability in progress

11.2 What History Teaches Us

11.2.1 Patience with long-term research programs

11.2.2 Danger of overpromising and underdelivering

11.2.3 Importance of robust evaluation metrics

11.2.4 Need for diverse perspectives and approaches

11.3 Preparing for the Future

11.3.1 Building resilient research institutions

11.3.2 Fostering responsible AI development

11.3.3 Maintaining human agency and control

11.3.4 Ensuring broad societal benefit

12 Conclusion

12.1 AI’s Remarkable Journey

12.1.1 From philosophical speculation to practical reality

12.1.2 Exponential acceleration in recent decades

12.1.3 Unprecedented potential and challenges ahead

12.2 The Road Ahead

12.2.1 Continued technical progress expectations

12.2.2 Importance of wisdom alongside intelligence

12.2.3 Need for thoughtful human guidance

12.2.4 AI as a tool for human flourishing

]]> https://vivekdeulkar.github.io/blog/posts/history-of-ai/ Wed, 28 May 2025 18:30:00 GMT Post With Code Vivek Deulkar https://vivekdeulkar.github.io/blog/posts/post-with-code/ This is a post with executable code.

]]> news code analysis https://vivekdeulkar.github.io/blog/posts/post-with-code/ Thu, 10 Apr 2025 18:30:00 GMT Welcome To My Blog Dr. Vivek Deulkar https://vivekdeulkar.github.io/blog/posts/welcome/ This is the first post in a Quarto blog. Welcome!

Since this post doesn’t specify an explicit image, the first image in the post will be used in the listing page of posts.

]]> news https://vivekdeulkar.github.io/blog/posts/welcome/ Mon, 07 Apr 2025 18:30:00 GMT The Future of Energy Storage Dr. Vivek Deulkar https://vivekdeulkar.github.io/blog/posts/energy-storage/

Introduction

The global transition to renewable energy sources presents unique challenges due to the intermittent nature of solar and wind power. As we move away from fossil fuels, the need for efficient and reliable energy storage solutions becomes increasingly critical. This post explores how lithium-ion batteries are playing a pivotal role in this transition and their potential to revolutionize our energy systems.

The Challenge of Intermittency

Renewable energy sources like solar and wind are inherently variable:

  • Solar power generation drops at night and during cloudy weather
  • Wind power fluctuates based on atmospheric conditions
  • Both can experience seasonal variations in output

This intermittency creates a fundamental mismatch between energy supply and demand, potentially leading to grid instability and reliability issues. Energy storage provides the solution to this challenge by:

  1. Storing excess energy during high production periods
  2. Releasing stored energy during low production or high demand periods
  3. Smoothing out fluctuations to maintain grid stability

Lithium-ion Technology: Current State and Future Potential

Lithium-ion batteries have emerged as the leading technology for grid-scale energy storage due to their:

  • High energy density
  • Decreasing costs (over 90% reduction in the past decade)
  • Improving cycle life and performance
  • Scalability from residential to utility applications

Recent advancements in lithium-ion technology have addressed many early concerns about cost, lifespan, and safety. Current research focuses on:

  • Improving energy density through new cathode and anode materials
  • Extending cycle life to match the 20+ year lifespan of renewable installations
  • Enhancing safety features and thermal management
  • Reducing dependency on rare or geopolitically sensitive materials

Optimizing Battery Storage Systems

My research at Plaksha University focuses on developing strategies to optimize battery storage deployment and operation. Key aspects include:

Strategic Sizing

Properly sizing battery systems is crucial for cost-effectiveness. Our work applies large deviations theory to determine optimal storage capacity that balances reliability and economic considerations.

Intelligent Control

Advanced reinforcement learning algorithms can optimize battery charging and discharging cycles, maximizing both battery lifespan and economic value through:

  • Energy arbitrage (buying/storing when prices are low, selling when high)
  • Grid services provision (frequency regulation, voltage support)
  • Peak demand reduction
  • Renewable integration support

Shared Battery Resources

Our research on statistical economies of scale in battery sharing demonstrates that communities can achieve significant cost savings through shared battery resources compared to individual installations.

Conclusion

Lithium-ion batteries represent a critical enabling technology for our renewable energy future. While challenges remain, the rapid pace of technological improvement and cost reduction suggests that widespread deployment of energy storage will accelerate in the coming years. As researchers continue to optimize these systems, we move closer to a sustainable, reliable, and efficient clean energy grid.

I welcome your thoughts and questions on this topic. Feel free to reach out via the contact page to discuss further.

]]> Energy Storage Sustainability Battery Technology https://vivekdeulkar.github.io/blog/posts/energy-storage/ Wed, 14 Feb 2024 18:30:00 GMT