MPAI Reaches the 2nd milestone of the Roadmap for Metaverse Interoperability

The international, non-profit, and unaffiliated Moving Picture, Audio and Data Coding by Artificial Intelligence (MPAI) organisation developing AI-based data coding standards has concluded its 31st General Assembly (MPAI-31) approving Version 1 of the MPAI Metaverse Model – Functionality Profiles.

Technical Report – MPAI Metaverse Model (MPAI-MMM) – Functionality Profiles (https://mmm.mpai.community/) implements the second step of the MPAI roadmap for metaverse implementation interoperability. It defines the protocol infrastructure enabling the different elements of a metaverse instance to request elements of the same or different metaverse instances to execute actions, such as locating and animating an avatar; verifies that the infrastructure can support several characteristic use cases; and defines four functionality profiles.

MPAI recognises the role of Simone Casale-Brunet, Gérard Chollet, Panos Kudumakis, and Paolo Ribeca in the development of Technical Report - MPAI Metaverse Model (MPAI-MMM) – Functionality Profiles V1.

The Reference Software of the CAE-EAE (Context-based Audio Enhancement https://mpai.community/standards/mpai-cae/ - Enhanced Audioconference Experience https://mpai.community/standards/mpai-cae/about-mpai-cae/#Figure4) is now available upon request from the MPAI secretariat (secretariat@mpai.community). By using the software and a microphone array, it is possible to separate and individually hear different audio sources at different positions.

MPAI is continuing its work plan comprising the development of the following Technical Specifications:

1) AI Framework (MPAI-AIF https://mpai.community/standards/mpai-aif/). V2 Technical Specification will enable an implementer to establish a secure AIF environment to execute AI Workflows (AIW) composed of AI Modules (AIM).

2) Avatar Representation and Animation (MPAI-ARA https://mpai.community/standards/mpai-ara/). V1 Technical Specification will support creation and animation of interoperable human-like avatar models expressing a Personal Status.

3) Multimodal Conversation (MPAI-MMC https://mpai.community/standards/mpai-mmc/). V2 Technical Specification will generalise the notion of Emotion by adding Cognitive State and Social Attitude and specify a new data type called Standard for Personal Status.

The MPAI work plan also includes exploratory activities, some of which are close to becoming standard or technical report projects:

1) AI Health (MPAI-AIH https://mpai.community/standards/mpai-aih). Targets an architecture where smartphones store users’ health data processed using AI and AI Models are updated using Federated Learning.

2) Connected Autonomous Vehicles (MPAI-CAV https://mpai.community/standards/mpai-cav). Targets the Human-CAV Interaction En-vironment Sensing, Autonomous Motion, and Motion Actuation subsystems implemented as AI Workflows.

3) End-to-End Video Coding (MPAI-EEV https://mpai.community/standards/mpai-eev). Extends the video coding frontiers using AI-based End-to-End Video coding.

4) AI-Enhanced Video Coding (MPAI-EVC https://mpai.community/standards/mpai-evc). Improves existing video coding with AI tools for short-to-medium term applications.

5) Server-based Predictive Multiplayer Gaming (MPAI-SPG https://mpai.community/standards/mpai-spg). Uses AI to train neural net-works that help an online gaming server to compensate data losses and detects false data.

6) XR Venues (MPAI-XRV https://mpai.community/standards/mpai-xrv). Identifies common AI Modules used across various XR-enabled and AI-enhanced use cases where venues may be both real and virtual.

It is still a good opportunity for legal entities supporting the MPAI mission and able to contribute to the development of standards for the efficient use of data to join MPA (https://mpai.community/how-to-join/join/).

Please visit the MPAI web site (https://mpai.community/), contact the MPAI secretariat (secretariat@mpai.community) for specific information, subscribe to the MPAI Newsletter and follow MPAI on social media:

- LinkedIn (https://www.linkedin.com/groups/13949076/).

- Twitter (https://twitter.com/mpaicommunity).

- Facebook (https://www.facebook.com/mpaicommunity).

- Instagram (https://www.instagram.com/mpaicommunity/).

- YouTube (https://youtube.com/c/mpaistandards).