Ibrahim Haddad, Ph.D.’s Post

Last month, Paris was the hub of #AI innovation as we hosted AI_dev Europe 2024. A convergence of ideas and technology, the conference brought together speakers from 50 diverse organizations, showcasing the dynamic nature of AI development across six major themes. Missed the live action? Don't worry! All sessions are now available on YouTube. Dive into the discussions and insights shared by leading experts and innovators in the field. 🔗 Watch here: https://hubs.la/Q02Fdy010 Great news! We have upcoming AI_dev conferences. Consider submitting a proposal or sponsoring the following events: 🇨🇳 AI_dev China is taking place on Aug 21-23 as a colocated event with KubeCon & Open Source Summit: https://lnkd.in/dYnf3bMJ. 🇯🇵 AI_dev Japan is taking place on Oct 28-29 in Tokyo. https://lnkd.in/d2mCDDB6 #oss #aidev #opensource

Last month, Paris was the hub of #AI innovation as we hosted AI_dev Europe 2024. A convergence of ideas and technology, the conference brought together speakers from 50 diverse organizations, showcasing the dynamic nature of AI development across six major themes. Missed the live action? Don't worry! All sessions are now available on YouTube. Dive into the discussions and insights shared by leading experts and innovators in the field. 🔗 Watch here: https://hubs.la/Q02Fdy010 Great news! We have upcoming AI_dev conferences. Consider submitting a proposal or sponsoring the following events: 🇨🇳 AI_dev China is taking place on Aug 21-23 as a colocated event with KubeCon & Open Source Summit: https://lnkd.in/dYnf3bMJ. 🇯🇵 AI_dev Japan is taking place on Oct 28-29 in Tokyo. https://lnkd.in/d2mCDDB6 #oss #aidev #opensource

Unity Catalog (UC) is an open source data catalog. It's a server that exposes two sets of OpenAPI endpoints: (1) Unity Catalog API ➜ "native" (2) Iceberg REST Catalog API ➜ converted to (1) under the hood UC uses an embedded H2 database as metastore. The metastore contains the data served by the APIs. Clients call the APIs to interact with data "assets". Clients are typically compute engines like Spark, Trino, and DuckDB. Assets can be: - table ➜ structured data - volume ➜ semi-structured or unstructured data - function ➜ data transformation logic - (more types on the roadmap, but not yet available) They are identified in a three-level namespace: <catalog>.<schema>.<asset> Each level in the namespace has their own API(s): (1) CatalogsApi ➜ catalog information (2) SchemasApi ➜ schema information  (3) TablesApi, VolumesApi, FunctionsApi ➜ asset metadata There are also APIs for "credentials vending": - TemporaryTableCredentialsApi ➜ temporary storage credentials for a table - TemporaryVolumeCredentialsApi ➜ temporary storage credentials for a volume credentials vending: UC requests temporary credentials from a storage provider and gives them to a client. Typical case: client GETs (b) and (c) to retrieve a data asset from storage. UC can be used as central access layer. If all clients access assets via the catalog, permissions can be managed in a single place. Open source Unity Catalog was released three weeks ago. The project is in an early stage. For example, credentials vending is currently only supported for AWS S3 and ML models are not yet available as asset type. #dataengineering #softwareengineering

Last week at AI_dev Europe in Paris, a diverse community of developers, researchers, and industry leaders gathered to delve into the latest advancements in #opensource generative AI and machine learning. The conference offered a rich agenda of insightful keynotes, detailed sessions, and dynamic discussions, providing attendees with an in-depth perspective on the evolving landscape and future trends of #AI. Check out our new blog post for a detailed recap of AI_dev Europe, including key insights from the keynote addresses and notable sessions. 🔗 https://lnkd.in/ee7XU9MQ #oss #lfaidata #linuxfoundation #aidev

The Technical Steering Committee has been seated, thank you in advance for your hard work in the months to come: Amr Abdelhalem, Fidelity Investments Malini Bhandaru, Intel Corporation - Chair Nathan Cartwright, CDW Justin Cormack, Docker, Inc Ke Ding, Intel Corporation Steven Grubb, Red Hat Robert Hafner, Comcast Logan Markewich, LlamaIndex Melissa McKay, JFrog #opensource #enterpriseAI #OPEA LF AI & Data Foundation Check out the first meeting and join us for future ones here: https://lnkd.in/eyA5Byph