Reconstructions Gallery
The majority of the reconstructions capture the correct colors, camera viewpoint, and semantics but struggle to piece them together in a natural way (our Good column).
We also see instances of poor reconstructions (Failure) and instances of faithful reconstructions (Success).
These reconstructions are from a model trained on the training data from all subjects and tested on BOLD Moments Subject 01's testing set (the Ground Truth GIFs are sped up versions of the original 3 second videos).
Note that a true reconstruction from brain activity may not be photorealistic as it depends on what the subject actually perceived and how stimulus features are represented throughout cortex.
None of our reconstruction efforts employed any post-hoc selection procedure.
To receive all subject 01 reconstructions on BMD and CC2017, fill out this Google Form
and you will be automatically provided with a download link.
Failure
Ground Truth

ID: 1003

ID: 1030

ID: 1035

ID: 1046

ID: 1057

ID: 1026

ID: 1033

ID: 1042

ID: 1049

ID: 1079
Reconstructed

ID: 1003

ID: 1030

ID: 1035

ID: 1046

ID: 1057

ID: 1026

ID: 1033

ID: 1042

ID: 1049

ID: 1079
Good
Ground Truth

ID: 1002

ID: 1016

ID: 1025

ID: 1032

ID: 1066

ID: 1076

ID: 1081

ID: 1096

ID: 1013

ID: 1024

ID: 1029

ID: 1056

ID: 1067

ID: 1077

ID: 1085

ID: 1101
Reconstructed

ID: 1002

ID: 1016

ID: 1025

ID: 1032

ID: 1066

ID: 1076

ID: 1081

ID: 1096

ID: 1013

ID: 1024

ID: 1029

ID: 1056

ID: 1067

ID: 1077

ID: 1085

ID: 1101
Success
Ground Truth

ID: 1008

ID: 1017

ID: 1028

ID: 1047

ID: 1093

ID: 1014

ID: 1019

ID: 1043

ID: 1060

ID: 1098
Reconstructed

ID: 1008

ID: 1017

ID: 1028

ID: 1047

ID: 1093

ID: 1014

ID: 1019

ID: 1043

ID: 1060

ID: 1098