laitimes

利用 NVIDIA AI Enterprise IGX 在边缘赋能任务关键型 AI

author:NVIDIA China
利用 NVIDIA AI Enterprise IGX 在边缘赋能任务关键型 AI

NVIDIA SDKs have played an important role in accelerating AI applications in areas such as smart cities, healthcare, and robotics. However, enabling production-grade AI solutions that can be deployed at the edge to securely and reliably support human-machine collaboration requires a combination of high-quality hardware and software tailored to the needs of the enterprise.

NVIDIA is once again accelerating mission-critical AI applications at the edge. NVIDIA AI Enterprise IGX is an enterprise-grade software solution that runs edge AI on the NVIDIA IGX platform.

NVIDIA IGX delivers ultra-fast AI performance and high-throughput data processing for your industrial-grade hardware, with the size and power required at the edge, as well as robust edge security, remote manageability, and built-in security.

The integration of NVIDIA IGX with NVIDIA AI Enterprise makes edge AI more accessible, efficient, and enterprise-friendly.

Enterprise demand for AI at the edge

The AI stack consists of and relies on many third-party applications and open-source software (OSS). Given its complexity and increasing dependencies, maintaining the security and stability of the AI software stack has become a daunting task, a resource-intensive task that hinders the pace of AI innovation for enterprises.

Here are some factors to consider:

  • Stability and reliability
  • Security and threat mitigation
  • Regulatory issues

Stability and reliability

Understanding all dependencies within a package is critical to maintaining the stability of the API. Any changes to third-party and open-source packages may require subsequent changes to the API, which can break the stack. This web of dependencies makes it nearly impossible for enterprises to standardize on the latest open source version in their deployments.

Security and threat mitigation

Expanding software dependencies increase the risk of introducing software vulnerabilities. These vulnerabilities can lead to attacks with serious consequences, such as data breaches, service outages, and huge financial losses.

A total of 4,135 critical vulnerabilities were reported in 2022, an increase of 59% from 2021. Industries with higher standards in terms of latency, privacy, bandwidth, and regulatory requirements are not immune. According to the article "Clinicians' Perspectives on Healthcare Cybersecurity and Cyber Threats," 24% of cyberattacks occurred in the healthcare industry in 2019, and in 2022, there was a surge in cyberattacks against hospitals.

Regulatory issues

Many highly regulated industries have strict regulations regarding the maintenance of AI software.

For example, the aerospace sector is increasingly using AI for navigation systems and flight control algorithms, with rigorous guidance to ensure continuous monitoring and updates to maintain system integrity and safety standards.

In the healthcare industry, AI-driven treatment and diagnostic tools must likewise adhere to strict maintenance protocols to guarantee the accuracy and reliability of the medical decision-making process.

NVIDIA AI Enterprise IGX

NVIDIA AI Enterprise IGX is a software solution purpose-built for running mission-critical applications on the NVIDIA IGX Orin platform.

It provides unmatched performance, security, stability, and support for the entire software stack, eliminating the headache of maintaining and securing complex AI software platforms, simplifying AI-enabled operations and enabling enterprises to deploy AI applications at scale with greater confidence.

Building on the success of NVIDIA AI Enterprise in the data center and cloud, the launch of NVIDIA AI Enterprise IGX extends these benefits to the edge.

NVIDIA AI Enterprise IGX is an industrial-grade, high-performance, enterprise-grade edge solution that works with NVIDIA IGX to provide comprehensive end-to-end software support for a wide range of firmware, operating systems, drivers, AI frameworks, SDKs, and libraries. With stable software distribution built specifically for NVIDIA IGX, you can get hardware and software support for longer periods of time required by critical use cases. In addition to being able to get support from a single source, you get long-term API stability and a consistent software bill of materials (SBOM).

The value of joining Enterprise Support is to provide solutions that resolve technical issues in a timely manner, ensuring the stability and reliability of edge AI systems and avoiding significant financial losses or operational disruptions due to downtime.

利用 NVIDIA AI Enterprise IGX 在边缘赋能任务关键型 AI

图 1. NVIDIA AI Enterprise IGX 和 NVIDIA IGX 平台

NVIDIA AI Enterprise IGX 包含基本的 AI 库和 SDK,例如 NVIDIA TensorRT、TensorFlow、PyTorch、NVIDIA Triton 推理服务器、Holoscan 和企业 Ubuntu Linux 操作系统等。

There are also two additional options:

  • Yocto:适用于部署 Yocto 的企业。
  • Functional safety: In areas where safety, people, and property are critical, such as industrial manufacturing, systems are ensured to protect critical assets and human lives with both active and passive safety strategies.

NVIDIA AI Enterprise IGX is designed to help enterprises build cutting-edge technologies while reducing total cost of ownership (TCO), accelerating time to market, and improving overall product development efficiency.

It has flexible software branches that provide options that match your industry needs and product development cycle:

  • Production branch: Ensure the stability of your API with monthly security updates. These branches are ideal for deploying AI in production environments where stability is required, and are released every 6 months with a lifecycle of 9 months.
  • Long-term support branch: Support the long-term app lifecycle with quarterly security updates. These branches are best suited for highly regulated AI applications, with releases every two and a half years and a lifecycle of up to 10 years.

During the challenging and complex development of edge AI, the solution provides a proven path to AI success.

开始使用 NVIDIA AI Enterprise IGX

If you're developing an edge AI application or ready to go into production, you can get started with NVIDIA AI Enterprise today:

  • Get started with the NVIDIA IGX Orin Developer Kit:
  • 联系 NVIDIA 申请 NVIDIA AI Enterprise IGX 软件试用:
  • 进一步了解 NVIDIA AI Enterprise IGX: