laitimes

Tsinghua alumni make meritorious contributions! Google released the first general medicine big model, 14 tasks SOTA!

author:Love Home Claude 2l1w

This article, only to do today's headlines first creation, please respect the legitimate rights and interests of the author, without my permission, do not carry plagiarism, violators will be held accountable. The article is more than 1,000 words, the content is more delicate, please click and pay attention before reading, so that you can continue to pay attention to the relevant content in the later stage.

Artificial intelligence technology in the medical field is increasingly becoming a key force leading the future, and among the latest achievements in this field, the release of the world's first general medical big model, Med-PaLM M, will undoubtedly set off a huge wave. The multimodal generative model, created by Google Research and DeepMind, not only understands clinical language, but also recognizes images and even understands genomics.

Tsinghua alumni make meritorious contributions! Google released the first general medicine big model, 14 tasks SOTA!

As an important breakthrough, the Med-PaLM M demonstrated impressive performance in all 14 test tasks, approaching or exceeding the current state of the art. More strikingly, according to data from 246 real chest X-rays, up to 40.50% of cases, the reports generated by Med-PaLM M are generally accepted by clinicians, exceeding the level of professional radiologists. This undoubtedly highlights the clinical application prospects of Med-PaLM M, which is no longer just a theoretical breakthrough, but a real and feasible technology.

What makes the Med-PaLM M so amazing is that it's built on MultiMedBench, Google's self-built multimodal medical testing protocol.

Tsinghua alumni make meritorious contributions! Google released the first general medicine big model, 14 tasks SOTA!

This benchmark integrates 12 open source datasets and 14 tasks, covering multiple biomedical data models and task types. With this benchmark, Med-PaLM M was able to fully demonstrate its general-purpose biomedical AI capabilities to not only answer questions and generate reports, but also perform tasks such as visual question answering, medical image classification, and genomic variant invocation.

The basic architecture of Med-PaLM M adopts the multimodal language model PaLM-E, and integrates the ViT pre-trained model as a visual encoder to form a variety of combinations. During the training process, the authors made fine fine-tuning to implement multimodal context inputs, which enabled Med-PaLM M to handle inputs containing multiple images.

Tsinghua alumni make meritorious contributions! Google released the first general medicine big model, 14 tasks SOTA!

This makes it excellent across 14 tasks, especially in the generation of radiological reports, more than 40% of which are more accurate than those of professional doctors.

However, while Med-PaLM M has made a huge breakthrough, Google is also candid to point out that there are still some limitations. High-quality test benchmarks remain a key bottleneck, which directly affects the development of general biomedical AI. The current MultiMedBench, while playing a catalytic role, is still limited in size and diversity of its datasets. In addition, there are challenges for scaling multimodal AI models, as the scarcity of biomedical data makes this operation not as simple as in other fields.

Tsinghua alumni make meritorious contributions! Google released the first general medicine big model, 14 tasks SOTA!

Overall, the release of Med-PaLM M marks an important step forward in general medical artificial intelligence, but its practical application still needs to face many challenges. Whether it can be quickly put into practical use requires further exploration and efforts. However, in any case, the emergence of Med-PaLM M has brought new hope to the medical field, revealing for us the unlimited potential of artificial intelligence in the medical field.

In conclusion, the release of Med-PaLM M is a milestone for the field of medical artificial intelligence. Its emergence is not only a technological breakthrough, but also a positive exploration of the future development of the medical field.

Tsinghua alumni make meritorious contributions! Google released the first general medicine big model, 14 tasks SOTA!