In this talk, we dissect the architecture and inner workings of Large Language Model (LLM) Agents and their pivotal role in enhancing task automation. By charting their development lifecycle, we'll uncover the specific challenges faced in their creation, and how state-of-the-art tools and techniques were deployed for solutions. We will talk about the different frameworks and techniques used by LLM users to create robust Chat applications, starting with raw Prompting to higher order prompts alongside Retrieval Augmented Generation and Agent s.