Saravana Thiagarajan Kathirvel

Short and very knowledgeable course from DeepLearning gives a high-level view on dense retrievals, rerank, num generation, and many more concepts around use cases for LLMs. https://lnkd.in/ex9sZrbV"

6

2 Comments

Pytorch has torched Tensorflow in terms of the # of LLMs which are using it and unfortunately we are getting into a stage where there will be only 1 framework (which is never good for innovation). One of the interesting things I noticed about this trend is that Tensorflow is still more popular in India and South America. Who is searching for Tensorflow in India? Your thoughts? #llms #genai #generatieveai #capgemini #llm #opensourceai #capgeminiindia #ai #artificialintelligence #software  #leaderboard #benchmark #benchmarking #pytorch #tensorflow

15

3 Comments

In this video, Puneet Jain Lara Rachidi and I explore the integration of MLflow into the fine-tuning process of pre-trained language models. Fine-tuning pre-trained Large Language Models (LLMs) on private datasets is an excellent customization option to increase a model’s relevancy for a specific task. For example, a base pre-trained transformer model without specialized fine-tuning will face challenges for certain tasks (e.g., understanding complex legal language and performing legal analysis). In such scenarios, fine-tuning a model while using tracking tools like MLflow helps ensure that every aspect of the training process (metrics, parameters, and artifacts) is reproducibly tracked and logged. This allows for the analysis, comparison, and sharing of tuning iterations. We discuss MLflow 2.12 and the recently introduced MLflow Deep Learning features to track all the important aspects of fine-tuning a large language model, including the use of automated logging of training checkpoints to simplify the process of resuming training. Check out the full discussion and learn more about how MLflow can enhance your fine-tuning process. #MachineLearning #AI #MLflow #DeepLearning #LanguageModels #FineTuning #DataScience #ArtificialIntelligence

26

I'm thrilled to announce my participation as a speaker at the highly anticipated 3AI #SPECTRA event, a confluence of cutting-edge AI and GenAI discussions with over 150+ renowned speakers across 3 insightful days. 🌟 During my session, I'll be delving into the best practices to maximize ROI for Generative AI initiatives within enterprises. Drawing from my hands-on experience driving multiple large-scale GenAI projects, I'll share valuable insights and strategies to unlock the true potential of this transformative technology. 🚀 Get ready to uncover: ✅ Key considerations for successful GenAI adoption and implementation at an enterprise scale. ✅ Proven methodologies to measure and optimize GenAI's impact on business outcomes. ✅ Real-world case studies and lessons learned from driving GenAI initiatives across diverse industries. ✅ Actionable tips to navigate challenges and accelerate time-to-value for your GenAI investments. Whether you're an AI leader, technology enthusiast, or a business decision-maker exploring the power of GenAI, this session promises to be an invaluable opportunity to gain practical knowledge and stay ahead of the curve. 🔍 Don't miss this chance to witness the live event and engage with industry experts pushing the boundaries of AI and GenAI. Join me at 3AI SPECTRA, where we'll collectively shape the future of intelligent systems and drive transformative change. 🌐 Mark your calendars and secure your spot today! Let's unlock the full potential of GenAI together. 💪 #3AISPECTRA #GenerativeAI #EnterpriseAI #AIAdoption #ROIOptimization #TechnologyLeadership

30

This time around it will be me presenting in our 33 Mywebinar by Mydbops Topic : Demystifying Real-Time Analytics with TiDB Time : Friday 21st June 24 | 3:30 PM IST Wherein I will discussing the inbuilt analytical engine with #TiDB, its architecture, replication and much more. If your struggling with existing analytics pipeline and external services , it can definitely help !! link : https://lnkd.in/gYGR6tFa #tidb #databases #mydbops #analytics #remotesupport #datamanagement

22

Level up your Generative AI development with Microsoft’s AI Toolkit! Shreyan J D Fernandes shares how AI Toolkit empowers you to run LLMs/SLMs locally. https://lnkd.in/gcGVZR6z AI toolkit enables you to: 💡Run pre-optimized AI models locally on various setups, including Windows 11 with DirectML acceleration or direct CPU, Linux with NVIDIA GPUs, or CPU-only environments. 💡Test and integrate models seamlessly using a user-friendly playground or a REST API for direct application incorporation. 💡Fine-tune models like popular SLMs Phi-3 and Mistral locally or in the cloud, enhancing performance, tailoring responses, and controlling style. 💡Deploy AI-powered features by choosing between cloud deployment or embedding them within your device applications. #AI #Microsoft #AIToolkit #msftadvocate

3

#GenAI models necessitates training on extensive datasets, which in turn requires robust #cloud storage solutions. As Gen AI continues to advance, demand for cloud services would surge correspondingly, creating a symbiotic growth relationship b/w the two. https://t.ly/9Rg-C

9

Ola Krutrim , India’s first AI unicorn, recently launched its LLM, Krutrim-7B-chat. This new model is trained in 10 Indian languages and is available on Databricks Marketplace. It can generate text in Hindi, English, Tamil, Telugu, Marathi, Malayalam, Gujarati, Bengali, and Kannada. This is the first of several India-specific models trained by Ola Krutrim. It has been trained on a massive dataset of Indic languages— “Krutrim delivers text infused with Indian sensibilities and cultural awareness.” Check out the model here. The announcement came to light at the Data Intelligence Day in Mumbai on May 10, 2024, by Gautam Bhargava, VP & Head of AI Engineering at Krutrim. “We’re excited to be at the forefront of building foundational LLMs trained on Indian languages to better serve our customers in India. We have been working very closely with the Databricks team to pre-train and finetune our foundational LLM,” said Bhargava. He added, “We are confident that Krutrim, our base model, will be able to provide high-quality responses in Indian languages and dialects.” According to Bhargava, Krutrim was trained using Databricks Mosaic AI Training’s GPU orchestration and system optimisations, enabling state-of-the-art generative AI solutions for customers globally. The model is now available on the Databricks Marketplace.

49

1 Comment

An interesting summary of the Gemini 1.5- technical report from Gradientflow. Report: https://lnkd.in/g_ne9gEy #llms #genai #generatieveai #capgemini #llm #opensourceai #capgeminiindia #ai #artificialintelligence #software  #leaderboard #benchmark #benchmarking #gemini #google

13

Grateful for the enlightening discussions on Data Lake vs Data Warehouse during our panel session at #DES2024 by AIM Events! Exciting times are ahead as AI and ML advancements promise to revolutionize storage practices.  Here are some key points and future predictions from our talk. 1️⃣ We talked about how to achieve incremental ROI with both storage approaches, considering specific goals. The rise of ML and AI will dramatically change data storage practices. With data volume, user base, and use cases expected to grow, big changes are coming. 2️⃣ AI capabilities are changing data engineering, making data preparation, pipeline management, and data movement faster and more automated. Future strategies need to focus on cost-effectiveness, flexibility, security, and governance. Hybrid approaches like the Data Lakehouse, which combine the best of Data Warehouses and Data Lakes, are becoming popular. 3️⃣ Edge computing will increase the need for better compute power in storage management. Real-time analytics will continue to improve storage practices. AI and ML integration will make data modeling and discovery easier. Additionally, data virtualization and federated queries will allow seamless data access across different sources without needing to move data physically. As we navigate this evolving landscape, it's important to stay updated on these changes and embrace innovative solutions for success. 🚀 How do you see AI and ML influencing your data management strategies? Let me know in the comment section below! #DataManagement #AI #ML #DataStorage #Innovation #DES24 #DES #AIM #ThinkAIThinkAIM #Datewarehouse #DataLake #DataLakehouse #GENAI

15

Come join us on ML School on Twitch as I and Rahul Srivastava, MBCS discuss about Generative AI Large Language Models. We will cover #LLM, Transformer Architecture, Fine tuning & pre-training, a bit of history and evolution of the models along with interesting demos. Join us: https://twitch.tv/aws on July 17th 2024 at 4 PM BST (GMT+1) / 11 AM EST #GenAI #AWS #Cloud #AI

27

Ai : Hunanity's greatest creation for Good and Bad. To secure ourself #zerotrustai In the journey, MS brings up VASA-1 will AI model which essentially spins a selfie image and turn it into a talking clip of you. All you have to do is upload a photo along with a voice note and let the AI model do the talking for you.

2

Gen AI in Identity Verification I'm proud to highlight the continued success of MetaMap‘s Generative AI solution for identity verification, launched in Q1 2024. After months of production use, it has demonstrated remarkable stability and efficiency. Key contributors: 1. Vikram Kalabi : Your robust ML pipeline has proven its resilience, consistently delivering accurate results at scale. 2. Vladislav I. : The human-computer interface you developed has been pivotal, allowing seamless human-in-the-loop feedback and continuous improvement. 3. Alan Garcia : Your operational leadership has ensured smooth integration of human oversight, maintaining high quality standards. This project exemplifies how cutting-edge AI, when thoughtfully implemented, can bring long-term value and reliability to critical processes. Kudos to Vikram, Vladislav, Alan, and the entire team for their ongoing commitment to excellence. #GenerativeAI #IdentityVerification #SustainedInnovation

69

5 Comments

What is Quantization in LLM and how it can affect the performance? to know more about it, please this latest blog written by me. for such more content please connect at: https://lnkd.in/ddYVEywk

5

Recently had the pleasure of interviewing Kai Waehner, Confluent’s Global Field CTO for Dataquest at the Kafka Summit Bangalore. We discussed how Confluent is pushing the boundaries of streaming analytics and data management. Our conversation highlighted Confluent's commitment to robust data flow, seamless collaboration, and enhanced security. Exciting times ahead for real-time data! #DataAnalytics #Streaming #KafkaSummit #Confluent #datastreaming #kafka #ApacheFlink

47

Looking forward to this panel where Divakar Tantravahi, Meduri Ravi Kumar, and Cosimo Spera will talk about the latest AI technologies that are changing product and customer support, along with their real world examples and practical strategies. If you have not registered, use this link - https://lnkd.in/gdTMgryA #ai #businessoutcomes #product #customer

22

After several months of rigorous efforts and time investment during late nights, early mornings on weekdays or weekends into deep research on Advanced Generative AI and Large Language Models, happy to share that we have crossed the finish line. Super Kudos to entire training team at OpenAI Microsoft Great Learning which came together to train some of the most brilliant minds in technology that I came across and equip us with the most leading edge knowledge that may possibly help shape the future of workflow in relevant projects across industries #ArtificialIntelligence #disruptoroftheyear #AIcommunity #DeepLearning #DigitalTransformation #ArtificialIntelligence #MachineLearning #DataScience #NeuralNetworks #Robotics #CognitiveComputing #NaturalLanguageProcessing #ComputerVision #AISolutions #FutureTech #IntelligentAutomation #AIApplications #SmartTech #AIethics #AIAAS

22

#achievmentannouncement sharing a great experience exploring the breadth and depth of #statistical and #mathematical models in the field of #datascience, #deeplearning and #artificialintelligence applications.

15

1 Comment

How to do iterative development for ML with Dockers on Amazon SageMaker Studio

9

1 Comment