blenderproc.python.loader.AMASSLoader module

class blenderproc.python.loader.AMASSLoader.AMASSLoader

Bases: object

AMASS is a large database of human motion unifying 15 different optical marker-based motion capture datasets by representing them within a common framework and parameterization. All of the mocap data is convereted into realistic 3D human meshes represented by a rigged body model called SMPL, which provides a standard skeletal representation as well as a fully rigged surface mesh. Warning: Only one part of the AMASS database is currently supported by the loader! Please refer to the AMASSLoader example for more information about the currently supported datasets.

Any human pose recorded in these motions could be reconstructed using the following parameters: “sub_dataset_identifier”, “sequence id”, “frame id” and “model gender” which will represent the pose, these parameters specify the exact pose to be generated based on the selected mocap dataset and motion category recorded in this dataset.

Note: if this module is used with another loader that loads objects with semantic mapping, make sure the other module is loaded first in the config file.

static _correct_materials(objects)

If the used material contains an alpha texture, the alpha texture has to be flipped to be correct

Parameters:objects (List[MeshObject]) – Mesh objects where the material might be wrong.

static _get_pose_parameters(supported_mocap_datasets, num_betas, used_sub_dataset_id, used_subject_id, used_sequence_id, used_frame_id)

Extract pose and shape parameters corresponding to the requested pose from the database to be processed by the parametric model

Parameters:

• supported_mocap_datasets (dict) – A dict which maps sub dataset names to their paths.
• num_betas (int) – Number of body parameters
• used_sub_dataset_id (str) – Identifier for the sub dataset, the dataset which the human pose object should be extracted from.
• used_subject_id (str) – Type of motion from which the pose should be extracted, this is dataset dependent parameter.
• used_sequence_id (int) – Sequence id in the dataset, sequences are the motion recorded to represent certain action.
• used_frame_id (int) – Frame id in a selected motion sequence. If none is selected a random one is picked

Return type:

Tuple[Forwardref, Forwardref]

Returns:

tuple of arrays contains the parameters. Type: tuple

static _get_supported_mocap_datasets(taxonomy_file_path, data_path)

get latest updated list from taxonomoy json file about the supported mocap datasets supported in the loader module and update.supported_mocap_datasets list

Parameters:

• taxonomy_file_path (str) – path to taxomomy.json file which contains the supported datasets and their respective paths. Type: string.
• data_path (str) – path to the AMASS dataset root folder. Type: string.

Return type:

dict

static _load_parametric_body_model(data_path, used_body_model_gender, num_betas, num_dmpls)

loads the parametric model that is used to generate the mesh object

Return type:Tuple[Forwardref, <built-in function array>] Returns:parametric model. Type: tuple.

static _write_body_mesh_to_obj_file(body_represenstation, faces, temp_dir)

write the generated pose as obj file on the desk.

Parameters:

• body_represenstation (torch.Tensor) – parameters generated from the BodyModel model which represent the obj pose and shape. Type: torch.Tensor
• faces (<built-in function array>) – face parametric model which is used to generate the face mesh. Type: numpy.array

Return type:

str

Returns:

path to generated obj file. Type: string.

human_skin_colors = ['2D221E', '3C2E28', '4B3932', '5A453C', '695046', '785C50', '87675A', '967264', 'A57E6E', 'B48A78', 'C39582', 'D2A18C', 'E1AC96', 'F0B8A0', 'FFC3AA', 'FFCEB4', 'FFDABE', 'FFE5C8']

blenderproc.python.loader.AMASSLoader.load_AMASS(data_path, sub_dataset_id, temp_dir=None, body_model_gender=None, subject_id='', sequence_id=-1, frame_id=-1, num_betas=10, num_dmpls=8)

use the pose parameters to generate the mesh and loads it to the scene.

Parameters:

• data_path (str) – The path to the AMASS Dataset folder in resources folder.
• sub_dataset_id (str) – Identifier for the sub dataset, the dataset which the human pose object should be extracted from. Available: [‘CMU’, ‘Transitions_mocap’, ‘MPI_Limits’, ‘SSM_synced’, ‘TotalCapture’, ‘Eyes_Japan_Dataset’, ‘MPI_mosh’, ‘MPI_HDM05’, ‘HumanEva’, ‘ACCAD’, ‘EKUT’, ‘SFU’, ‘KIT’, ‘H36M’, ‘TCD_handMocap’, ‘BML’]
• temp_dir (Optional[str]) – A temp directory which is used for writing the temporary .obj file.
• body_model_gender (Optional[str]) – The model gender, pose will represented using male, female or neutral body shape. Available:[male, female, neutral]. If None is selected a random one is choosen.
• subject_id (str) – Type of motion from which the pose should be extracted, this is dataset dependent parameter. If left empty a random subject id is picked.
• sequence_id (int) – Sequence id in the dataset, sequences are the motion recorded to represent certain action. If set to -1 a random sequence id is selected.
• frame_id (int) – Frame id in a selected motion sequence. If none is selected a random one is picked
• num_betas (int) – Number of body parameters
• num_dmpls (int) – Number of DMPL parameters

Return type:

List[MeshObject]

Returns:

The list of loaded mesh objects.