Gaurab Bose

1. IMO, agent patterns are one of the most interesting ways to extend LLMs. memary is based on leveraging a graph database (neo4j) for long-term memory (to get around the limited memory inherent in even the largest context windows in LLMs) and augmenting it with other tools like web search and Computer Vision. https://lnkd.in/gfFcBqJx Looks interesting. 2. More about how consolidation effects the entire healthcare industry: https://lnkd.in/gXJKqNJB The Change hack/ransomware attack not only affected claims, service, refills, etc. but now CMS & NCQA are delaying the entire HEDIS reporting process (used for Medicare/Medicaid quality ratings) due to the impact. 3. NARA bans ChatGPT use agency-wide. https://lnkd.in/gW8T94JU Federal Government agencies see this as a risk, including their information leaking and being used to train models (which may then output the wrong information or show PII/PHI other proprietary information). 4. Oh great, now I can't even be angry anymore :) https://lnkd.in/gcrN9mjx

1

1 Comment

Aidan Gomez, CEO and co-founder of Cohere, has been instrumental in developing generative AI. His work at Google in 2017 on transformers laid the groundwork for today's AI advancements. In a recent interview, Gomez talked about Cohere's mission to create practical, easy-to-integrate AI models that drive profitability by automating tasks and enhancing efficiency. He stressed the scalability and accessibility of Cohere's AI solutions, aiming to democratize AI for all businesses. #AI #GenerativeAI #Cohere #TechInnovation #BusinessGrowth #Automation #AIIntegration #Scalability #AidanGomez

3

Join us 𝐧𝐞𝐱𝐭 𝐓𝐡𝐮𝐫𝐬𝐝𝐚𝐲, 𝐌𝐚𝐲 23 𝐚𝐭 12-1 𝐩𝐦 𝐄𝐓 to dive deep into the world of ⚡𝐋𝐋𝐌 𝐀𝐥𝐢𝐠𝐧𝐦𝐞𝐧𝐭⚡ with Andrew Jardine, Head of GTM at Adaptive ML, and Julien Launay, Co-founder and CEO at Adaptive ML! 🤖 🔁 👦 📚  Agenda: - Understanding the importance of preference alignment for LLMs - Exploring the differences between RL and other techniques - Practical guidance on how to implement these techniques yourself Register for this and our future Transferred Learning sessions here 👉https://lnkd.in/g3c6aJkd 📝 #genAI #LLMalignment #RHLF #AdaptiveML #AI #ML

30

1 Comment

Last night I had the fortune of representing LaunchDarkly at Sourcegraph's CodeAI Summit NYC. An important theme I took from last night's event? Context. Models like specifics. Computers can't read our brains or know what we want to achieve. Technology is kinda useless without the right context. As we move forward in this increasingly AI-generated world (for better and for worse) let us not forget the importance of adding context to the equation. Whether that's providing context to a dataset through how it was collected, sharing context of your repo to better aid a code assist tool, or simply providing context behind the why of our decisions. It's an interesting (and important) place to keep in our minds. #AI #MachineLearning #DeveloperAdvocacy #DeveloperEvents

14

1 Comment

Falkonry (Suhas Mehta and Ashis Khan) and iba AG (Eric Snyder) will present how steel makers are pivoting to AI & Data driven decision support system at AISTech 2024 today (May 6, 2024) - please join us if you are interested. I co-authored this paper with Eric Snyder of iba AG.

66

5 Comments

Here is a prime (and hilarious) example of terrible use of LLMs. You are trying to sell me a product and the image below is your example. A couple problems: First, our business has nothing to do with "enhancing railways", so whatever "research" your Cohere and Claude Opus models did was worse than useless. The rest of the fluff in the paragraph is based on the misinformation so it begins to sound like buzzword bingo. Second, you've demonstrated that your product will miss the mark so badly, it'll create a massive amount of noise and work for us that we'd lose money trying to use it. "PS: Full disclosure, we let our AI and automation handle the copywriting and outbound process this time. We decided to use Cohere for research and Claude Opus for copy, aiming to one-up the usual ChatGPT antics. If it turns out we've missed the mark, shoot us a message and we'll reevaluate (or atleast give our AIs a pep talk)!" Stop churning out garbage. Building solutions on LLMs requires the same level of thought, planning, and execution as any other project.

10

6 Comments

4 models made available today: - Meta Chameleon: 7B & 34B language models - Meta Multi-Token Prediction LLM - Meta JASCO: text-to-music models - Meta AudioSeal: audio watermarking model

31

I wrote a blog post on a thorny but underappreciated problem in ML-based marketing personalization: event attribution. It's how you go from the actions you take and customer behavior you observe to creating training experiences for your model. Good attribution makes a huge difference in driving uplift, there are a lot of degrees of freedom in configuring it, and at the same time, it's rarely discussed in ML/bandits/RL literature.

38

4 Comments

We are thrilled to announce the release of OpenBioLLM-Llama3-70B & 8B from Saama AI Research Labs. These groundbreaking models outperform Openai’s GPT-4, Google’s Gemini, Meditron-70B, Google’s Med-PaLM-1, and Google’s  Med-PaLM-2 in the biomedical domain, setting a new state-of-the-art for models of their size. Both models underwent a rigorous two-phase fine-tuning process using the LLama-3 70B & 8B models as the base and leveraging Direct Preference Optimization (DPO) for optimal performance. This release is just the beginning! In the coming months, we'll introduce expanded medical domain coverage, longer context windows, better benchmarks, and multimodal capabilities. Stay tuned for our upcoming official paper. This work was led by Ankit Pal Bhaskar Sambasivan Lisa Moneymaker Ari Srinivasan Rajeev Dadia Pravin Kumar Prithiviraj S Kamal Raj Kanakarajan Tamil Arasan Ph.D. Murugesan Vadivel Selvakumar Murugan Mahesh Narasimhan Basant Shanker Sas Maheswaran Panikos Christofi Rajasekar Nonburaj (𝑅𝒥) Navin Kumaran Vikas Kishore Geetha Eswaran Ojasvi Harsola Angu S K. Ramanathan Srinivasan Model download link is in the first comment.

831

106 Comments

HomeTrust using Abacus.AI! Supercharge your gen-AI use cases and build dozes of AI agents to automate your business in days using Abacus.AI :) Thanks, Alina!!

59

1 Comment

Excerpt from an Angel Squad memo that we invested in recently: “[Company] is led by a team of scientists and engineers with PhD-level expertise in Machine Learning, Engineering Simulations, and Computational Materials Science. The team is headed by CEO, [Name], who previously led AI development at two early-stage startups. [Name] is joined by CTO, [Name], who has deep experience in machine learning and materials science, and Chief Science Officer, [Name], a doctoral researcher at the [School]. “ Investing at the earliest stages of value creation often means taking big bets on a founding team. At Angel Squad and Hustle Fund, we love founders with deep expertise and super domain knowledge, particularly in deep tech verticals.

28

3 Comments

👉 Howdy LinkedIn! Tomorrow, on "Building Products with Generative AI" - I will be hosting 🚘 Nitin Kartik at 11:30AM CST/12:30 PM EST! We're going to be digging into the intersection of Product Marketing & Generative AI, as well as other topics that will branch from Nitin's experience in the space. I'm excited for another interesting episode with a great thought leader in the space - we hope to see you join for tomorrow's episode! #GenerativeAI #AI #ProductMarketing

15

2 Comments

"what was missing from language models was “they didn’t understand the spatial context you’re in . . . so that limits their usefulness in the end"...Demis Hassabis Yann LeCun said LLMs had “very limited understanding of logic . . . do not understand the physical world, do not have persistent memory, cannot reason in any reasonable definition of the term and cannot plan." The solution? VERSES The Spatial Web Standards will enable new forms of AI to evolve beyond large language models. Spatial Web Foundation George Percivall Gabriel René What say you Gary Marcus The Standard for Spatial Web Protocol, Architecture and Governance is moving to the final balloting process at the Institute of Electrical and Electronics Engineers (IEEE). IEEE “This progress is the result of our efforts over the past five years where we have been working to develop the social and technical standards with the IEEE to help ensure that AI systems are safe, secure, and trustworthy. The report we issued, ‘The Future of AI Governance,’ combined with the legal input from the law firm Dentons, provides our unique perspective on global artificial intelligence governance. Dentons Link Legal #ai #activeinference

20

1 Comment

LinkedIn team (Juan Pablo Bottaro Karthik Ramgopal) shared a helpful deep dive into their deployment of an LLM-powered job search assistant. Highly recommend this read! Few highlights:  💡 Relatively easy to setup RAG-based pipeline. Achieved 80% of the basic experience in 1 month, then 4 more months to reach 95% mark. 💡 Evaluating the quality of application outputs is hard. I hear this from many enterprises developing LLM applications. (check out Okareo by Matthew Wyman Boris Selitser) 💡 Balancing latency with quality is important. While certain techniques like Chain of Thought could improve accuracy and reduce hallucinations, it will increase response times, which can affect user experience. https://lnkd.in/gtGGwf5P #largelanguagemodels #RAG #EBR #LLM #ml #ai #hallucinations #evaluations #

4

Analysis: Key technical leader departs OpenAI Ilya Sutskever, really is the brains behind the whole operation. Chief Scientist, board member and co-founder.. This happened two days after, the hype announcement of GPT-4o. With both Andrej Karpathy & Ilya Sutskever leaving within the last few months, this leaves a rather large technical gap in the leadership team of the Research Lab. The GPT-4o announcement happening 1 day before 'Google I/O 2024', largely overshadowing the event. Personally I think this is good for Microsoft, its stock is up 8% this month, to put that in perspective - 250 billion USD, or 5 and half Twitters!! Previously OpenAI actively attempted to remove all emotions from their AI, recent audio demos of the new speech model seems to be going in the other direction using science fiction as a product roadmap. The curious change is rather sudden and may be explained by Mustafa Suleyman recently becoming the CEO of Microsoft AI Mustafa Suleyman previously CEO of Inflection AI was creating an emotionally aware chatbot called 'Pi'. 1 day ago 'John Schulman' one of the remaining technical co-founders of OpenAI, was the guest of a well known AI podcast, this appearance seems genuine and not a PR effort - https://lnkd.in/gEcrvmvU Big changes in the AI world, remember OpenAI is a Research Lab first and foremost - with many of the founding researchers departing within a few months, sending an interesting market signal. All in all this is good news for Microsoft Corp, edging closer to the previous 52 week high. Guardian article in the comments.

9

10 Comments

Hey, I'd like to give a shout-out to ClearML for helping us at Vimeo develop AI-based systems. We have been happy customers for a few years now and I'd like to share a bit about how we use ClearML. We use ClearML Datasets to cache a dataset of video transcripts, and run testing loading directly from ClearML Datasets. This allows us to simultaneously speed up the data loading and ensure consistency. Moreover we use ClearML to save our benchmark annotations in one place and track our system performance on the benchmark every-time we run an experiment or change our prompts. ClearML allows us to see the different parameters and prompts that were used for each experiment and to monitor improvements or regressions in our performance. We also use ClearML to run large-scale tests and help with statistical evaluation of our methods. For example, we developed a RAG (Retrieval Augmented Generation) Q&A system and wanted to verify that the LLM will not answer certain questions or user queries that are outside the scope of the video. We used ClearML to collect and analyze the RAG responses on many videos for predefined user queries that were outside the scope of the videos and got good visibility into the performance of the system. Also, the comparison feature on ClearML is great for tracking the improvement of our metrics along the progressing versions of our systems.

29

1 Comment

Three years ago, I pitched and received funding for an idea that focused on preventing safety and compliance incidents in target geographies. This was before GenAI was all the craze. We leveraged an ensemble of ML models (ex: CV, NER) that scanned millions of tunnel images in fulfillment centers, and a human-in-loop system that closes the gap when inference confidence was low. Today, I rejoice when I witness other teams working on reducing product damages under Project P.I., which uses a combination of GenAI and Computer Vision to scan 100’s of millions of products, improving the customer experience. I can’t wait to witness what teams across Amazon achieve with GenAI as they focus on solving real-life, papable challenges on behalf of customers. This is the type of GenAI ROI that I believe in! Kudos to them all. You can check more about Project P.I. in the article below: https://lnkd.in/g_SnqhgA cc: Amazon Science #genai #technology #artificialintelligence Set the 🔔 notification on my page, don’t miss a post!

110

13 Comments

An interesting new pattern has emerged in the last two weeks where mysterious LLMs are showing up from nowhere without any clear ownership or other details. For example, a mysterious chatbot version called "gpt2-chatbot" is outperforming GPT-4, Gemini 1.5, and Claude. You can check it here - https://chat.lmsys.org/ People are speculating this is from OpenAI.. but I expect many LLM builders are going throw mysterious model in the wild, and this is going get more confusing over time. #llm #mysteries #openai

17

1 Comment