Reconstructions Gallery

The majority of the reconstructions capture the correct colors, camera viewpoint, and semantics but struggle to piece them together in a natural way (our Good column). We also see instances of poor reconstructions (Failure) and instances of faithful reconstructions (Success). These reconstructions are from a model trained on the training data from all subjects and tested on BOLD Moments Subject 01's testing set (the Ground Truth GIFs are sped up versions of the original 3 second videos). Note that a true reconstruction from brain activity may not be photorealistic as it depends on what the subject actually perceived and how stimulus features are represented throughout cortex. None of our reconstruction efforts employed any post-hoc selection procedure.

To receive all subject 01 reconstructions on BMD and CC2017, fill out this Google Form and you will be automatically provided with a download link.

Failure
Ground Truth
Ground Truth gif 1003
ID: 1003
Ground Truth gif 1030
ID: 1030
Ground Truth gif 1035
ID: 1035
Ground Truth gif 1046
ID: 1046
Ground Truth gif 1057
ID: 1057
Ground Truth gif 1026
ID: 1026
Ground Truth gif 1033
ID: 1033
Ground Truth gif 1042
ID: 1042
Ground Truth gif 1049
ID: 1049
Ground Truth gif 1079
ID: 1079
Reconstructed
Failure gif 1003
ID: 1003
Failure gif 1030
ID: 1030
Failure gif 1035
ID: 1035
Failure gif 1046
ID: 1046
Failure gif 1057
ID: 1057
Failure gif 1026
ID: 1026
Failure gif 1033
ID: 1033
Failure gif 1042
ID: 1042
Failure gif 1049
ID: 1049
Failure gif 1079
ID: 1079
Good
Ground Truth
Ground Truth gif 1002
ID: 1002
Ground Truth gif 1016
ID: 1016
Ground Truth gif 1025
ID: 1025
Ground Truth gif 1032
ID: 1032
Ground Truth gif 1066
ID: 1066
Ground Truth gif 1076
ID: 1076
Ground Truth gif 1081
ID: 1081
Ground Truth gif 1096
ID: 1096
Ground Truth gif 1013
ID: 1013
Ground Truth gif 1024
ID: 1024
Ground Truth gif 1029
ID: 1029
Ground Truth gif 1056
ID: 1056
Ground Truth gif 1067
ID: 1067
Ground Truth gif 1077
ID: 1077
Ground Truth gif 1085
ID: 1085
Ground Truth gif 1101
ID: 1101
Reconstructed
Good gif 1002
ID: 1002
Good gif 1016
ID: 1016
Good gif 1025
ID: 1025
Good gif 1032
ID: 1032
Good gif 1066
ID: 1066
Good gif 1076
ID: 1076
Good gif 1081
ID: 1081
Good gif 1096
ID: 1096
Good gif 1013
ID: 1013
Good gif 1024
ID: 1024
Good gif 1029
ID: 1029
Good gif 1056
ID: 1056
Good gif 1067
ID: 1067
Good gif 1077
ID: 1077
Good gif 1085
ID: 1085
Good gif 1101
ID: 1101
Success
Ground Truth
Ground Truth gif 1008
ID: 1008
Ground Truth gif 1017
ID: 1017
Ground Truth gif 1028
ID: 1028
Ground Truth gif 1047
ID: 1047
Ground Truth gif 1093
ID: 1093
Ground Truth gif 1014
ID: 1014
Ground Truth gif 1019
ID: 1019
Ground Truth gif 1043
ID: 1043
Ground Truth gif 1060
ID: 1060
Ground Truth gif 1098
ID: 1098
Reconstructed
Success gif 1008
ID: 1008
Success gif 1017
ID: 1017
Success gif 1028
ID: 1028
Success gif 1047
ID: 1047
Success gif 1093
ID: 1093
Success gif 1014
ID: 1014
Success gif 1019
ID: 1019
Success gif 1043
ID: 1043
Success gif 1060
ID: 1060
Success gif 1098
ID: 1098