EEGVision: Reconstructing vision from human brain signals

[1] Jokanović, V., & Jokanović, B. (2021). Brain-Computer Interface: State-of-Art, Challenges, and the Future. In Artificial Intelligence (pp. 203-227). Chapman and Hall/CRC. Search in Google Scholar

[2] Machado, T. A., Kauvar, I. V., & Deisseroth, K. (2022). Multiregion neuronal activity: the forest and the trees. Nature Reviews Neuroscience, 23(11), 683-704. Search in Google Scholar

[3] Zacks, J. M., Speer, N. K., Swallow, K. M., Braver, T. S., & Reynolds, J. R. (2007). Event perception: a mind-brain perspective. Psychological bulletin, 133(2), 273. Search in Google Scholar

[4] Scotti, P., Banerjee, A., Goode, J., Shabalin, S., Nguyen, A., Dempster, A., ... & Abraham, T. (2024). Reconstructing the mind's eye: fMRI-to-image with contrastive learning and diffusion priors. Advances in Neural Information Processing Systems, 36. Search in Google Scholar

[5] Bai, Y., Wang, X., Cao, Y. P., Ge, Y., Yuan, C., & Shan, Y. (2023). Dreamdiffusion: Generating high-quality images from brain eeg signals. arXiv preprint arXiv:2306.16934. Search in Google Scholar

[6] Lan, Y. T., Ren, K., Wang, Y., Zheng, W. L., Li, D., Lu, B. L., & Qiu, L. (2023). Seeing through the brain: image reconstruction of visual perception from human brain signals. arXiv preprint arXiv:2308.02510. Search in Google Scholar

[7] Fu, H., Shen, Z., Chin, J. J., & Wang, H. (2023). BrainVis: Exploring the Bridge between Brain and Visual Signals via Image Reconstruction. arXiv preprint arXiv:2312.14871. Search in Google Scholar

[8] Yang, L., Zhen, H., Li, L., Li, Y., Zhang, H., Xie, X., & Zhang, R. Y. (2023). Functional diversity of visual cortex improves constraint-free natural image reconstruction from human brain activity. Fundamental Research. Search in Google Scholar

[9] Meng, L., & Yang, C. (2024). Semantics-Guided Hierarchical Feature Encoding Generative Adversarial Network for Visual Image Reconstruction From Brain Activity. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 32, 1267-1283. Search in Google Scholar

[10] Mridha, M. F., Das, S. C., Kabir, M. M., Lima, A. A., Islam, M. R., & Watanobe, Y. (2021). Brain-computer interface: Advancement and challenges. Sensors, 21(17), 5746. Search in Google Scholar

[11] Luan, L., Robinson, J. T., Aazhang, B., Chi, T., Yang, K., Li, X., ... & Xie, C. (2020). Recent advances in electrical neural interface engineering: minimal invasiveness, longevity, and scalability. Neuron, 108(2), 302-321. Search in Google Scholar

[12] Sanei, S., & Chambers, J. A. (2013). EEG signal processing. John Wiley & Sons. Search in Google Scholar

[13] Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., ... & Sutskever, I. (2021, July). Learning transferable visual models from natural language supervision. In International conference on machine learning (pp. 8748-8763). PMLR. Search in Google Scholar

[14] Li, J., Li, D., Xiong, C., & Hoi, S. (2022, June). Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. In International conference on machine learning (pp. 12888-12900). PMLR. Search in Google Scholar

[15] Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022). High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 10684-10695). Search in Google Scholar

[16] Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ... & Bengio, Y. (2014). Generative adversarial nets. Advances in neural information processing systems, 27. Search in Google Scholar

[17] Cheng, M., Liu, Q., Liu, Z., Zhang, H., Zhang, R., & Chen, E. (2023). Timemae: Self-supervised representations of time series with decoupled masked autoencoders. arXiv preprint arXiv:2303.00320. Search in Google Scholar

[18] Meng, C., He, Y., Song, Y., Song, J., Wu, J., Zhu, J. Y., & Ermon, S. (2021). Sdedit: Guided image synthesis and editing with stochastic differential equations. arXiv preprint arXiv:2108.01073. Search in Google Scholar

[19] Kavasidis, I., Palazzo, S., Spampinato, C., Giordano, D., & Shah, M. (2017, October). Brain2image: Converting brain signals into images. In Proceedings of the 25th ACM international conference on Multimedia (pp. 1809-1817). Search in Google Scholar

[20] Vahdat, A., & Kautz, J. (2020). NVAE: A deep hierarchical variational autoencoder. Advances in neural information processing systems, 33, 19667-19679. Search in Google Scholar

[21] Tirupattur, P., Rawat, Y. S., Spampinato, C., & Shah, M. (2018, October). Thoughtviz: Visualizing human thoughts using generative adversarial network. In Proceedings of the 26th ACM international conference on Multimedia (pp. 950-958). Search in Google Scholar

[22] He, K., Chen, X., Xie, S., Li, Y., Dollár, P., & Girshick, R. (2022). Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 16000-16009). Search in Google Scholar

[23] Jang, E., Gu, S., & Poole, B. (2016). Categorical reparameterization with gumbel-softmax. arXiv preprint arXiv:1611.01144. Search in Google Scholar

[24] Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022). Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125, 1(2), 3. Search in Google Scholar

[25] Spampinato, C., Palazzo, S., Kavasidis, I., Giordano, D., Souly, N., & Shah, M. (2017). Deep learning human mind for automated visual classification. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 6809-6817). Search in Google Scholar

[26] Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., ... & Fei-Fei, L. (2015). Imagenet large scale visual recognition challenge. International journal of computer vision, 115, 211-252. Search in Google Scholar

[27] Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., ... & Houlsby, N. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929. Search in Google Scholar

[28] Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016). Improved techniques for training gans. Advances in neural information processing systems, 29. Search in Google Scholar

[29] Khare, S., Choubey, R. N., Amar, L., & Udutalapalli, V. (2022). NeuroVision: perceived image regeneration using cProGAN. Neural Computing and Applications, 34(8), 5979-5991. Search in Google Scholar

[30] McInnes, L., Healy, J., & Melville, J. (2018). Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426. Search in Google Scholar