/* ---- Google Analytics Code Below */
Showing posts with label Omniverse. Show all posts
Showing posts with label Omniverse. Show all posts

Sunday, January 15, 2023

NVIDIA Goes Virtual Assistants

To me an unexpected direction.   Apparently a prototype early access effort for partners.   

Develop Intelligent Virtual Assistants with NVIDIA Omniverse ACE Early Access

By Stephanie Rubenstein and Alex Qi    NVIDIA

NVIDIA just announced at CES 2023 that early access is now available for NVIDIA Omniverse Avatar Cloud Engine (ACE). Developers and teams building avatars and virtual assistants can register to join the program, which includes access to the Omniverse ACE suite of cloud-native AI microservices for faster, easier development of interactive avatars.

Early partners include Ready Player Me, whose avatar was showcased in the CES demo. With this early access program, NVIDIA is looking for developers and partners to provide feedback on the microservices, collaborate on product improvement, and help push the limits of what’s possible with lifelike, interactive, digital humans. Applicants are reviewed and approved on a rolling basis as the program continues to expand.   .... ' 

What is the Omniverse ACE early access program?

Methods for developing avatars often require expertise, specialized equipment, and manually intensive workflows.

To ease avatar creation, Omniverse ACE enables the seamless integration of NVIDIA AI technologies—including pre-built models, tool sets, and domain-specific reference applications. The available avatar applications are built on most engines and deployed on public or private clouds.

Monday, January 09, 2023

Rapidly Generate 3D Assets for Virtual Words

 Seems odd, but can make sense, especially if you have to do many variants.  And, of course they can be just starting points for editing in more complex details.  Note mention of 'Digital Twins'.

Rapidly Generate 3D Assets for Virtual Worlds with Generative AI  By Gavriel State in NVIDIA

Tags: Digital Twin & Metaverse, News, Omniverse, synthetic data

To accelerate the development of 3D worlds and the metaverse, NVIDIA has launched numerous AI research projects to help creators across industries unlock new possibilities with generative AI.

Generative AI will touch every aspect of the metaverse and it is already being leveraged for use cases like bringing AI avatars to life with Omniverse ACE. Many of these projects, like Audio2Face and Audio2Gesture, which generate animations from audio, have turned into widely loved tools in the Omniverse community.

At CES, NVIDIA unveiled new generative AI technologies coming to Omniverse to help create virtual worlds faster and easier than ever. These models are available as both third-party Connectors from NVIDIA partners and internal AI projects published by the NVIDIA research team as extensions in AI ToyBox.

All generative AI research projects and Connectors available in NVIDIA Omniverse use legally licensed and purchased datasets.

Accelerating 3D content creation with generative AI Connectors and extensions

NVIDIA Omniverse is bringing in the latest and greatest generative AI technologies with Connectors and extensions for third-party technologies.

Move.ai generates animations from body movements. Move.ai enables you to capture human motion anywhere and export directly into Omniverse.

Video 1. An example of an individual boxing in NVIDIA Omniverse, with Move.ai motion data powering the character.

Lumirithmic generates 3D mesh for heads from facial scans. The connector enables you to easily create movie-grade avatars from facial scans and enables 3D scanning at scale for any industry. “We’re excited to be working with NVIDIA to bring our 3D facial scanning products through Omniverse to creators, gamers, and developers, democratizing access to the highest quality 3D faces for gaming, adtech, metaverse, and other applications,” said Gaurav Chawla, co-founder and CEO of Lumirithmic.


Tuesday, November 08, 2022

Anyone can Build Omniverse Applications?

 Though still a skeptic of the current Omniverse,   I admit that NVIDIA being involved can make it move. 

Anyone Can Build Metaverse Applications With New Beta Release of NVIDIA Omniverse

By Frank DeLise

Digital Twin & Metaverse, News, Omniverse, open source, Universal Scene Description

The new beta release of NVIDIA Omniverse is now available with major updates to core reference applications and tools for developers, creators, and novices looking to build metaverse applications.

Each of the core components of the Omniverse platform have been updated to make it even faster, more accessible, and more flexible for collaborative workflows across applications. These updates empower developers of any background to easily build their custom applications, connections, and extensions anywhere. Learn more about how to develop on NVIDIA Omniverse.

Powered by support for new NVIDIA Ada Generation GPUs and advances in NVIDIA simulation technology, this new beta release focuses on maximizing ease of ingesting large, complex scenes from multiple third-party applications, and maximizing real-time rendering, path tracing, and physics simulation.

Graphic of the five core components of NVIDIA Omniverse: Nucleus, Connect, Kit, Simulation, and RTX Renderer.

Figure 1. The five core components of NVIDIA Omniverse

Nucleus, the central database and collaboration engine of NVIDIA Omniverse, now enables faster live collaboration and copying between servers. Nucleus Navigator 3.2 makes it possible to move files and folders seamlessly between servers located on-premises and in the cloud. It also adds enhanced search functionality to quickly retrieve images, objects, and other assets. OmniObjects with Omniverse Live 2.0 allows faster collaboration between Connectors.

New and updated Connectors for popular apps are available through Omniverse Connect, the libraries that allow you to create Connectors from your favorite apps to the Omniverse platform. The beta release includes new and updated Connectors for PTC Creo, Autodesk Alias, Kitware ParaView, Siemens JT, and Autodesk Maya, among others.

PhysX 5, the flagship tool of Omniverse Simulation, has been open sourced so you can easily modify, build, and distribute your own physics simulation applications. The new version of PhysX comes with exciting new features like support for multiple scenes, collision-triggered audio, and an inspector for robotic applications. Experience Omniverse Simulation by downloading Omniverse and testing technical demos in Omniverse Showroom to see the power of PhysX 5 and real-time RTX Rendering.

New features and capabilities across Omniverse applications are driven by Omniverse Kit 104, which now allows novice or experienced Python and C++ developers to more easily develop, package, and publish their own custom metaverse applications and extensions to accelerate industry-specific workflows.  ... ' 

Friday, October 21, 2022

Applying the Metaverse, are we Ready?

Considerable piece. We experimented with the basic idea, and am skeptical  we are ready for it.  But deserves some realistic tests

Applying the Metaverse  By Keith Kirkpatrick

Communications of the ACM, November 2022, Vol. 65 No. 11, Pages 16-18  10.1145/3565470

three figures interact in the metaverse, illustration

Trying to distill and describe what is being called the metaverse today is a bit like trying to describe the Internet to people in the 1970s or 1980s: the framework and building blocks were there, but few pundits were able to accurately encompass, delineate, and predict the applications that gained traction, the wide-ranging technological achievements that would occur, and how everyday life has been impacted via the commercial use of a worldwide network of computer servers.

What Is the Metaverse?

The metaverse has been described as a network of virtual worlds, where augmented reality (AR), virtual reality (VR), and the Internet come together to provide a fully immersive, three-dimensional (3D) experience to users. Technology stalwarts such as Meta (the company formerly known as Facebook) have gone on a public relations blitz to depict a world in which doctors might be able to practice operating in a VR world before ever using a scalpel on a patient, or where people can feel immersed in remote locations and experiencing the sights and sounds as if they were there, while sitting in their homes wearing VR googles and headsets.

Indeed, AR, VR, holographic technology, and high-speed, low-latency communication networks are typically described as the foundational elements of the metaverse. Yet the specifics of which use cases, applications, and companies will drive the development of the metaverse and thrive in its new ecosystems remains an open question.

"No one knows what the metaverse is right now, other than the fact that people are speculating heavily because they're speculating on virtual property," says Jennifer deWinter, a professor of arts, communications, and humanities at Worcester Polytechnic Institute (WPI) in Worcester, MA. "I think Face-book is imagining it as a 3D digital environment. If you expand it out into a bunch of tech entrepreneurs or futurists, it's probably a grouping of applications still in and around the same idea of digitized selves."

The idea of immersive, digital communities was around long before Facebook decided to rebrand and capitalize on the metaverse. Nearly 20 years ago, virtual communities that allowed people to connect with each other in an immersive, fully digital environment, such as Second Life and Habbo Hotel, sprung up and introduced the concept and use of "avatars," digital representations of a real person depicted in a virtual environment. Not surprisingly, Hollywood got into the act as well, with movies such as the aptly named Avatar, as well as Jumanji, where children are sucked into the virtual world of the game itself and actually become their digital avatars.

The metaverse will require three elements in order to become as ubiquitous as the Internet itself: a robust communications infrastructure, powerful and easy-to-use development platforms and, perhaps most importantly, compelling applications that provide value to users that cannot be replicated or found elsewhere.

Building the Metaverse

The development and rollout of 5G and 6G communications networks will serve as the backbone for the metaverse, which will require fast, always-on, and rich data exchange among users, virtual worlds or environments, and applications. In particular, graphics-intensive technologies such as AR, VR, and holograms will not function optimally without robust, reliable communications networks.

The metaverse also will require platforms that allow content creators to develop the virtual worlds in which users will interact, as well as supporting the technologies that bring these digital worlds to life. Today, the most common platforms being used for metaverse VR platforms are Decentraland and Voxels, which are virtual-world, browser-based platforms where users can buy virtual plots of land in the platform as NFTs, but this will change as existing players enter this new space, explains Prashant Kelker, partner, digital strategy and solutions, for technology research and advisory firm ISG.

Kelker also observes that several large hyperscale companies (which have vast amounts of cloud-based compute, memory, networking, and storage resources) likely will support the initial infrastructure needed to support metaverse applications. For example, Kelker says Meta plans to develop a massive supercomputer to power the metaverse, and has selected the European Union to develop the metaverse technology in order to create more employment in Europe.

He also cites NVIDIA's development of metaverse-ready assets known as Omniverse, Apple's creation of a head-mounted display (HMD) virtual meeting application, and Unity Software's efforts to supply a development platform that supports 3D, VR, and AR-based environments.

"The key element in my mind that needs to be solved is kickstarting a parallel market between creators and consumers," says James Kaplan, co-founder and CEO of conversational AI company MeetKai. "There needs to be a major push from the entire ecosystem to make content easier to create."  ... ' 

Thursday, October 06, 2022

Intro to Robotic Simulaton in Isaac Sim

Of interest, new to me:

SELF-PACED ONLINE COURSE

Introduction to Robotic Simulations in Isaac Sim

Robotic automation has enjoyed great success in recent years with increasing hardware capabilities driving innovation in simulation and machine learning. In this course, we introduce you to Isaac Sim, NVIDIA Omniverse’s solution for simulation and robotics.

In this course, you’ll learn how to tap into the simulation loop of a 3D engine and initialize experiments with objects, robots, and physics logic. This can be done programmatically using Omniverse Kit and Pixar USD commands, but the course will use Isaac Sim Core to wrap these low-level operations in an object-oriented fashion. By the end of the course, you’ll be able to simulate and control NVIDIA JetBot and Franka Emika robots and coordinate them together to perform a handoff.

The skills covered in this course are direct prerequisites for working with Isaac Gym and create a good starting point for exploring Isaac Sim and other Omniverse applications. The course is great for those interested in 3D scene specification and robotic simulation, but is also useful for researchers looking to expand their toolkits as well as seasoned developers interested in exploring design patterns for Omniverse KIT development.

Learning Objectives

By participating in this course, you will learn how to:

Develop for a simulation application using an interactive Python scripting interface.

Specify scenes with USD components and enforce simulation-time properties.

Launch tasks that can encapsulate complex logic in the simulation environment.

Import and control an NVIDIA JetBot wheeled robot and a Franka Emika robotic arm.

Execute a robotic handoff between two robots working in simulation.

Upon completion, you will have the prerequisite knowledge and experience to explore Isaac Sim's more advanced features, explore the code base, and do non-trivial project development in the robotic space.

Course Details  ... (Much more at link) 

Tuesday, August 30, 2022

Kroger to Reinvent Shopping Experience with NVIDIA Omniverse

Want to see this ...

Kroger Reinvents the Shopping Experience with NVIDIA AI   in Retailwire

Kroger and NVIDIA embarked on a strategic collaboration to reimagine the shopping experience using AI applications and services. Discover the progress made by adopting AI and NVIDIA Omniverse.

 Register now: 

Monday, April 18, 2022

Nvidia and OVX System for Digital Twins

Recall our early use of twin style simulation models.

Nvidia Unveils OVX System Purpose-Built for Industrial Digital Twins

By Jaime Hampton   in Datanami

Tuesday at its GTC developer conference, Nvidia launched a new computing system for industrial digital twins, the Nvidia OVX.

Nvidia OVX was created for the purpose of running digital twin simulations within the Omniverse, Nvidia’s industrial operations metaverse that is “a real-time physically accurate world simulation and 3D design collaboration platform.”  “Just as we have DGX for AI, we now have OVX for Omniverse,” said Nvidia CEO Jensen Huang in his GTC keynote.

In fast-paced industries constrained by time, physical space, and computing limitations, digital twin technology is promising to transform operations through advanced designing, modeling, and testing capabilities.

“Physically accurate digital twins are the future of how we design and build,” said Bob Pette, vice president of Professional Visualization at Nvidia. “Digital twins will change how every industry and company plans. The OVX portfolio of systems will be able to power true, real-time, always-synchronous, industrial-scale digital twins across industries.”

Specifications

A first generation Omniverse OVX computing system is comprised of eight Nvidia A40 GPUs, three Nvidia ConnectX-6 Dx 200-Gbps NICs, dual Intel Ice Lake 8362 CPUs, 1TB system memory, and 16TB NVMe storage. The OVX computing system can be scaled from a single pod of eight OVX servers up to a SuperPOD of 32 OVX servers when connected with Spectrum-3 switch fabric. Multiple SuperPODS can also be deployed for larger simulation needs.

Capabilities

“OVX will enable designers, engineers, and planners to build physically accurate digital twins of buildings or create massive, true-to-reality simulated environments with precise time synchronization across physical and virtual worlds,” said Nvidia. With the ever-increasing complexity within industry, the testing and evaluation of intricate systems and processes that often operate simultaneously and autonomously can be challenging or sometimes impossible. Creating a digital twin of these systems, such as those in a factory or warehouse involving autonomous vehicles or robots, allows companies to digitally optimize operations for better efficiency or innovation before actual, real-world deployment of modifications or developments.

In his keynote address, Huang noted that because of the complexity of industrial systems, “the Omniverse software and computer need to be scalable, low latency and support precise time,” and since data centers process data in the lowest possible time, but not in precise time, the company wanted to create a “synchronous data center” with OVX. “Most importantly, the network and computers are synchronized using precision timing protocol and RDMA minimizes packet transfer latency,” Huang said.  .... "