Machine Studying Communities: Q1 ‘23 highlights and achievements — Google for Builders Weblog


Posted by Nari Yoon, Bitnoori Keum, Hee Jung, DevRel Neighborhood Supervisor / Soonson Kwon, DevRel Program Supervisor

Let’s discover highlights and accomplishments of huge Google Machine Studying communities over the primary quarter of 2023. We’re enthusiastic and grateful about all of the actions by the worldwide community of ML communities. Listed here are the highlights!

ML Campaigns

ML Neighborhood Dash

ML Neighborhood Dash is a marketing campaign, a collaborative try bridging ML GDEs with Googlers to supply related content material for the broader ML group. All through Feb and Mar, MediaPipe/TF Advice Dash was carried out and 5 initiatives have been accomplished.

ML Olympiad 2023

I'm hosting a competiton ML Olympiad 2023 #MLOlympiad

ML Olympiad is an related Kaggle Neighborhood Competitions hosted by ML GDE, TFUG, Third-party ML communities, supported by Google Builders. The second, ML Olympiad 2023 has wrapped up efficiently with 17 competitions and 300+ members addressing vital problems with our time – range, environments, and many others. Competitors highlights embrace Breast Most cancers Prognosis, Water High quality Prediction, Detect ChatGpt solutions, Guarantee wholesome lives, and many others. Thanks all for taking part in ML Olympiad 2023!

Additionally, “ML Paper Studying Golf equipment” (GalsenAI and TFUG Dhaka), “ML Math Golf equipment” (TFUG Hajipur and TFUG Dhaka) and “ML Research Jams” (TFUG Bauchi) have been hosted by ML communities around the globe.

Neighborhood Highlights


Screen shot of Fine-tuning Stable Diffusion using Keras

Varied methods of serving Secure Diffusion by ML GDE Chansung Park (Korea) and ML GDE Sayak Paul (India) shares how you can deploy Secure Diffusion with TF Serving, Hugging Face Endpoint, and FastAPI. Their different challenge Effective-tuning Secure Diffusion utilizing Keras supplies how you can fine-tune the picture encoder of Secure Diffusion on a customized dataset consisting of image-caption pairs.

Serving TensorFlow fashions with TFServing by ML GDE Dimitre Oliveira (Brazil) is a tutorial explaining how you can create a easy MobileNet utilizing the Keras API and how you can serve it with TF Serving.

Effective-tuning the multilingual T5 mannequin from Huggingface with Keras by ML GDE Radostin Cholakov (Bulgaria) reveals a minimalistic strategy for coaching textual content era architectures from Hugging Face with TensorFlow and Keras because the backend.

Image showing a range of low-lit pictures enhanced incljuding inference time and ther metrics

Lighting up Photographs within the Deep Studying Period by ML GDE Soumik Rakshit (India), ML GDE Saurav Maheshkar (UK), ML GDE Aritra Roy Gosthipaty (India), and Samarendra Sprint explores deep studying methods for low-light picture enhancement. The article additionally talks a few library, Restorers, offering TensorFlow and Keras implementations of SoTA picture and video restoration fashions for duties equivalent to low-light enhancement, denoising, deblurring, super-resolution, and many others.

Use Cosine Decay Studying Price Scheduler in Keras? by ML GDE Ayush Thakur (India) introduces how you can accurately use the cosine-decay studying charge scheduler utilizing Keras API.

Screen shot of Implementation of DreamBooth using KerasCV and TensorFlow

Implementation of DreamBooth utilizing KerasCV and TensorFlow (Keras.io tutorial) by ML GDE Sayak Paul (India) and ML GDE Chansung Park (Korea) demonstrates DreamBooth approach to fine-tune Secure Diffusion in KerasCV and TensorFlow. Coaching code, inference notebooks, a Keras.io tutorial, and extra are within the repository. Sayak additionally shared his story, [ML Story] DreamBoothing Your Approach into Greatness on the GDE weblog.

Focal Modulation: A substitute for Self-Consideration by ML GDE Aritra Roy Gosthipaty (India) shares a Keras implementation of the paper. Usha Rengaraju (India) shared Keras Implementation of NeurIPS 2021 paper, Augmented Shortcuts for Imaginative and prescient Transformers.

Photographs classification with TensorFlow & Keras (video) by TFUG Abidjan defined how you can outline an ML mannequin that may classify photos in line with the class utilizing a CNN.

Arms-on Workshop on KerasNLP by GDG NYC, GDG Hoboken, and Stevens Institute of Expertise shared how you can use pre-trained Transformers (together with BERT) to categorise textual content, fine-tune it on customized information, and construct a Transformer from scratch.

On-device ML

Secure diffusion instance in an android utility — Half 1 & Half 2 by ML GDE George Soloupis (Greece) demonstrates how you can deploy a Secure Diffusion pipeline inside an Android app.

AI for Artwork and Design by ML GDE Margaret Maynard-Reid (United States) delivered a quick overview of how AI can be utilized to help and encourage artists & designers of their inventive house. She additionally shared just a few use circumstances of on-device ML for creating inventive Android apps.

ML Engineering (MLOps)

Overall system architecture of End-to-End Pipeline for Segmentation with TFX, Google Cloud, and Hugging Face

Finish-to-Finish Pipeline for Segmentation with TFX, Google Cloud, and Hugging Face by ML GDE Sayak Paul (India) and ML GDE Chansung Park (Korea) mentioned the essential particulars of constructing an end-to-end ML pipeline for Semantic Segmentation duties with TFX and numerous Google Cloud providers equivalent to Dataflow, Vertex Pipelines, Vertex Coaching, and Vertex Endpoint. The pipeline makes use of a customized TFX part that’s built-in with Hugging Face Hub – HFPusher.

Prolong your TFX pipeline with TFX-Addons by ML GDE Hannes Hapke (United States) explains how you should utilize the TFX-Addons elements or examples.

Textual Inversion Pipeline architecture

Textual Inversion Pipeline for Secure Diffusion by ML GDE Chansung Park (Korea) demonstrates how you can handle a number of fashions and their prototype purposes of fine-tuned Secure Diffusion on new ideas by Textual Inversion.

Working a Secure Diffusion Cluster on GCP with tensorflow-serving (Half 1 | Half 2) by ML GDE Thushan Ganegedara (Australia) explains how you can arrange a GKE cluster, how you can use Terraform to arrange and handle infrastructure on GCP, and how you can deploy a mannequin on GKE utilizing TF Serving.

Photo of Googler Joinal Ahmed giving a talk at TFUG Bangalore

Scalability of ML Purposes by TFUG Bangalore centered on the challenges and options associated to constructing and deploying ML purposes at scale. Googler Joinal Ahmed gave a chat entitled Scaling Giant Language Mannequin coaching and deployments.

Discovering and Constructing Purposes with Secure Diffusion by TFUG São Paulo was for people who find themselves enthusiastic about Secure Diffusion. They shared how Secure Diffusion works and confirmed a whole model created utilizing Google Colab and Vertex AI in manufacturing.

Accountable AI

Thumbnail image for Between the Brackets Fairness & Ethics in AI: Perspectives from Journalism, Medicine and Translation

In Equity & Ethics In AI: From Journalism, Medication and Translation, ML GDE Samuel Marks (United States) mentioned accountable AI.

In The brand new age of AI: A Convo with Google Mind, ML GDE Vikram Tiwari (United States) mentioned accountable AI, open-source vs. closed-source, and the way forward for LLMs.

Accountable IA Toolkit (video) by ML GDE Lesly Zerna (Bolivia) and Google DSC UNI was a meetup to debate moral and sustainable approaches to AI improvement. Lesly shared in regards to the “ethic” aspect of constructing AI merchandise in addition to studying about “Accountable AI from Google”, PAIR guidebook, and different experiences to construct AI.

Ladies in AI/ML at Google NYC by GDG NYC mentioned sizzling subjects, together with LLMs and generative AI. Googler Priya Chakraborty gave a chat entitled Privateness Protections for ML Fashions.

ML Analysis

Environment friendly Job-Oriented Dialogue Methods with Response Choice as an Auxiliary Job by ML GDE Radostin Cholakov (Bulgaria) showcases how, in a task-oriented setting, the T5-small language mannequin can carry out on par with present techniques counting on T5-base and even greater fashions.

Studying JAX in 2023: Half 1 / Half 2 / Livestream video by ML GDE Aritra Roy Gosthipaty (India) and ML GDE Ritwik Raha (India) lined the ability instruments of JAX, particularly grad, jit, vmap, pmap, and in addition mentioned the nitty-gritty of randomness in JAX.

Screen grab from JAX Streams: Parallelism with Flax | Ep4 with David Cardozo and Cristian Garcia

In Deep Studying Mentoring MILA Quebec, ML GDE David Cardozo (Canada) did mentoring for M.Sc and Ph.D. college students who’ve pursuits in JAX and MLOps. JAX Streams: Parallelism with Flax | EP4 by David and ML GDE Cristian Garcia (Columbia) explored Flax’s new APIs to assist parallelism.

March Machine Studying Meetup hosted by TFUG Kolkata. Two periods have been delivered: 1) You do not know TensorFlow by ML GDE Sayak Paul (India) offered some under-appreciated and under-used options of TensorFlow. 2) A Information to ML Workflows with JAX by ML GDE Aritra Roy Gosthipaty (India), ML GDE Soumik Rakshit (India), and ML GDE Ritwik Raha (India) delivered on how one may consider utilizing JAX practical transformations for his or her ML workflows.

A paper assessment of PaLM-E: An Embodied Multimodal Language Mannequin by ML GDE Grigory Sapunov (UK) defined the main points of the mannequin. He additionally shared his slide deck about NLP in 2022.

An annotated paper of On the significance of noise scheduling in Diffusion Fashions by ML GDE Aakash Nain (India) outlined the consequences of noise schedule on the efficiency of diffusion fashions and techniques to get a greater schedule for optimum efficiency.


Three initiatives have been awarded as TF Neighborhood Highlight winners: 1) Semantic Segmentation mannequin inside ML pipeline by ML GDE Chansung Park (Korea), ML GDE Sayak Paul (India), and ML GDE Merve Noyan (France), 2) GatedTabTransformer in TensorFlow + TPU / in Flax by Usha Rengaraju, and three) Actual-time Object Detection within the browser with YOLOv7 and TF.JS by ML GDE Hugo Zanini (Brazil).

Constructing rating fashions powered by multi-task studying with Merlin and TensorFlow by ML GDE Gabriel Moreira (Brazil) describes how you can construct TensorFlow fashions with Merlin for recommender techniques utilizing multi-task studying.

Transform your Web Apps with Machine Learning: Unleashing the Power of Open-Source Python Libraries like TensorFlow Hub & Gradio Bhjavesh Bhatt @_bhaveshbhatt

Constructing ML Powered Internet Purposes utilizing TensorFlow Hub & Gradio (slide) by ML GDE Bhavesh Bhatt (India) demonstrated how you can use TF Hub & Gradio to create a completely practical ML-powered net utility. The presentation was held as a part of an occasion known as AI Evolution with TensorFlow, protecting the basics of ML & TF, hosted by TFUG Nashik.

create-tf-app (repository) by ML GDE Radostin Cholakov (Bulgaria) reveals how you can arrange and keep an ML challenge in Tensorflow with a single script.


Creating scalable ML options to assist massive techs evolution (slide) by ML GDE Mikaeri Ohana (Brazil) shared how Google might help massive techs to generate impression by way of ML with scalable options.

Search of Brazilian Legal guidelines utilizing Dialogflow CX and Matching Engine by ML GDE Rubens Zimbres (Brazil) reveals how you can construct a chatbot with Dialogflow CX and question a database of Brazilian legal guidelines by calling an endpoint in Cloud Run.

4x4 grid of sample results from Vintedois Diffusion model

Secure Diffusion Finetuning by ML GDE Pedro Gengo (Brazil) and ML GDE Piero Esposito (Brazil) is a fine-tuned Secure Diffusion 1.5 with extra aesthetic photos. They used Vertex AI with a number of GPUs to fine-tune it. It reached Hugging Face high 3 and greater than 150K folks downloaded and examined it.


Leave a Reply

Your email address will not be published. Required fields are marked *