Researchers at the Leibniz-Institut für Analytische Wissenschaften (Isas) and Peking University have developed a free compression software. This cutting-edge toolbox is transforming the landscape of bioimaging AI, enabling scientists to process massive data sets with existing AI models at a fraction of the usual time and energy cost.
Efficient-Bio-AI can significantly increase the efficiency of neural networks in bioimaging without limiting the accuracy of the models.
Artificial intelligence (AI) has become an indispensable component in the analysis of microscopic data. However, while AI models are becoming better and more complex, the computing power and associated energy consumption are also increasing. Researchers at the Leibniz-Institut für Analytische Wissenschaften (Isas) and Peking University have therefore created a free compression software that allows scientists to run existing bioimaging AI models faster and with significantly lower energy consumption. The researchers have now presented their user-friendly toolbox called Efficient-Bio-AI (open source) in Nature Methods.
Modern microscopy techniques produce a large number of high-resolution images, and individual data sets can comprise thousands of them. Scientists often use AI-supported software to reliably analyse these data sets. However, as AI models become more complex, the latency (processing time) for images can significantly increase. “High network latency, for example with particularly large images, leads to higher computing power and ultimately to increased energy consumption”, says Dr Jianxu Chen, head of the Ambiom — Analysis of Microscopic Biomedical Images junior research group at Isas.
To avoid high latency in image analysis, especially on devices with restricted computing power, researchers use sophisticated algorithms to compress the AI models. This means they reduce the amount of computations in the models while retaining comparable prediction accuracy. “Model compression is a technique that is widely used in the field of digital image processing, known as computer vision, and AI to make models lighter and greener,” explains Chen. Researchers combine various strategies to reduce memory consumption, speed up model inference, the ‘thought process’ of the model — and thus save energy. Pruning, for example, is used to remove excess nodes from the neural network. “These techniques are often still unknown in the bioimaging community. Therefore, we wanted to develop a ready-to-use and simple solution to apply them to common AI tools in bioimaging”, says Yu Zhou, the paper's first author and PhD student at Ambiom.
The adaptability of Efficient-Bio-AI was tested using several applications. One example is the 3D semantic segmentation. The AI model identifies specific structures within a three-dimensional cellular environment. The illustration shows the segmentation of osteocytes (mature bone cells) in images of mouse bones. The images were taken using light sheet fluorescence microscopy. The figure shows the original image (column 1), the segmentation by the FNet 3D model (column 2) from the MMV_Im2Im toolbox for image-to-image transformation, and the segmentation after compression of FNet 3D by EfficientBioAI (column 3). The comparison (columns 2 and 3) shows that compression does not reduce the accuracy of the segmentation at all.
(Source: Isas / Prof. Dr. Anika Grüneboom (Bioimaging))
Energy Savings of up to 81 Percent
To put their new toolbox to the test, the researchers led by Chen tested their software on several real-life applications. With different hardware and various bioimaging analysis tasks, the compression techniques were able to significantly reduce latency and cut energy consumption by between 12.5 and 80.6 percent. “Our tests show that Efficient-Bio-AI can significantly increase the efficiency of neural networks in bioimaging without limiting the accuracy of the models”, summarises Chen. He illustrates the energy savings using the commonly used Cellpose model as an example: if a thousand users were to use the toolbox to compress the model and apply it to the Jump Target ORF dataset (around one million microscope images of cells) they could save energy equivalent to the emissions of a car journey of around 7,300 miles (approx. 11,750 kilometres).
No Special Knowledge Required
The authors are keen to make Efficient-Bio-AI accessible to as many scientists in biomedical research as possible. Researchers can install the software and seamlessly integrate it into existing Pytorch libraries (open-source programme library for the Python programming language). For some widely used models, such as Cellpose, researchers can therefore use the software without having to make any changes to the code themselves. To support specific change requests, the group also provides several demos and tutorials. With just a few changed lines of code, the toolbox can then also be applied to customised AI models.
Naturally, we always handle your personal data responsibly. Any personal data we receive from you is processed in accordance with applicable data protection legislation. For detailed information please see our privacy policy.
Consent to the use of data for promotional purposes
I hereby consent to Vogel Communications Group GmbH & Co. KG, Max-Planck-Str. 7-9, 97082 Würzburg including any affiliated companies according to §§ 15 et seq. AktG (hereafter: Vogel Communications Group) using my e-mail address to send editorial newsletters. A list of all affiliated companies can be found here
Newsletter content may include all products and services of any companies mentioned above, including for example specialist journals and books, events and fairs as well as event-related products and services, print and digital media offers and services such as additional (editorial) newsletters, raffles, lead campaigns, market research both online and offline, specialist webportals and e-learning offers. In case my personal telephone number has also been collected, it may be used for offers of aforementioned products, for services of the companies mentioned above, and market research purposes.
Additionally, my consent also includes the processing of my email address and telephone number for data matching for marketing purposes with select advertising partners such as LinkedIn, Google, and Meta. For this, Vogel Communications Group may transmit said data in hashed form to the advertising partners who then use said data to determine whether I am also a member of the mentioned advertising partner portals. Vogel Communications Group uses this feature for the purposes of re-targeting (up-selling, cross-selling, and customer loyalty), generating so-called look-alike audiences for acquisition of new customers, and as basis for exclusion for on-going advertising campaigns. Further information can be found in section “data matching for marketing purposes”.
In case I access protected data on Internet portals of Vogel Communications Group including any affiliated companies according to §§ 15 et seq. AktG, I need to provide further data in order to register for the access to such content. In return for this free access to editorial content, my data may be used in accordance with this consent for the purposes stated here. This does not apply to data matching for marketing purposes.
Right of revocation
I understand that I can revoke my consent at will. My revocation does not change the lawfulness of data processing that was conducted based on my consent leading up to my revocation. One option to declare my revocation is to use the contact form found at https://contact.vogel.de. In case I no longer wish to receive certain newsletters, I have subscribed to, I can also click on the unsubscribe link included at the end of a newsletter. Further information regarding my right of revocation and the implementation of it as well as the consequences of my revocation can be found in the data protection declaration, section editorial newsletter.