Hyeong-Seok Choi, Changdae Park, and Kyogu Lee, “From Inference to Generation: End-to-end Fully Self-supervised Generation of Human Face from Speech”, to appear in Proceedings of International Conference on Learning epresentations (ICLR), 2020
Jie Hwan Lee, Hyeong-Seok Choi, and Kyogu Lee, “Audio query-based music source separation”, in Proceedings of International Society for Music Information Retrieval Conference (ISMIR), 2019
Juheon Lee, Hyeong-Seok Choi, Chang-bin Jeon, Junghyun Koo, and Kyogu Lee, “Adversarially Trained End-to-end Korean Singing Voice Synthesis System”, in Proceedings of Interspeech, 2019, Best Student Paper Award
Juheon Lee, Sungkyun Chang, Sangkeun Choe, and Kyogu Lee, “COVER SONG IDENTIFICATION USING SONG-TO-SONG CROSS-SIMILARITY MATRIX WITH CONVOLUTIONAL NEURAL NETWORK”, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2018
Yoonchang Han, Jaehun Kim, Kyogu Lee, “Deep convolutional neural networks for predominant instrument recognition in polyphonic music”, IEEE/ACM Transactions on Audio, Speech, and Language Processing, Vol. 25(1), pp. 208-221, 2017
"자기회귀적 적대적 생성 신경망 기반의 가창 합성 및 평가 모델 연구", 미래창조과학부/전략과제, 2017.11.01~2020.10.31
"심상의 소리: 적대적 신경망을 활용한 크로스-모달 오디오 합성/변환 연구", 과학기술정보통신부/원천기술개발사업,  2017.11.01~2020.12.31
"뇌·인지 발달과정의 기초-영아단계 모사형 실세계 상호작용 경험 기반 객체 관련 개념의 기계학습 기술, 과학기술정보통신부/정보통신방송연구개발사업", 2019.04.01~2022.12.31

Lee HH, Kim H. Intact metabolite spectrum mining by deep learning in proton magnetic resonance spectroscopy of the brain. Magn Reson Med 2019;82:33-48.
Lee H, Lee HH, Kim H. Reconstruction of spectra from truncated free induction decays by deep learning in proton magnetic resonance spectroscopy. Magn Reson Med 2020 https://doi.org/10.1002/mrm.28164.
Lee HH, Kim H. Deep learning-based target metabolite isolation and big data-driven measurement uncertainty estimation in proton magnetic resonance spectroscopy of the brain. Magn Reson Med 2020 (in press)

Re-weighting Based Group Fairness Regularization via Classwise Robust Optimization. Sangwon Jung, Taeeon Park, Sanghyuk Chun, and Taesup Moon. The 11th International Conference on Learning Representations (ICLR), May 2023

Descent Steps of a Relation-Aware Energy Produce Heterogeneous Graph Neural Networks. Hongjoon Ahn, Youngyi Yang, Quan Gan, David Wipf, and Taesup Moon. Neural Information Processing Systems (NeurIPS), December 2022

GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-training. Jaeseok Byun, Taebaek Hwang, Jianlong Fu, and Taesup Moon. European Conference on Computer Vision (ECCV), October 2022

Learning Fair Classifiers with Partially Annotated Group Labels. Sangwon Jung, Sanghyuk Chun, and Taesup Moon. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2022

SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning. Sungmin Cha, Beomyoung Kim, Youngjoon Yoo, and Taesup Moon. Neural Information Processing Systems (NeurIPS), December 2021

SS-IL: Separated Softmax for Incremental Learning. Hongjoon Ahn, Jihwan Kwak, Subin Lim, Hyeonsu Bang, Hyojun Kim, and Taesup Moon. International Conference on Computer Vision (ICCV), October 2021

Fair Feature Distillation for Visual Recognition. Sangwon Jung, Donggyu Lee, Taeeon Park, and Taesup Moon. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2021

FBI-Denoiser: Fast Blind Image Denoiser for Poisson-Gaussian Noise. Jaeseok Byun, Sungmin Cha, and Taesup Moon. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2021

Continual Learning with Node-Importance based Adaptive Group Sparse Regularization. Sangwon Jung, Hongjoon Ahn, Sungmin Cha, and Taesup Moon. Neural Information Processing Systems (NeurIPS), December 2020

Uncertainty-based continual learning with adaptive regularization. Hongjoon Ahn, Sungmin Cha, Donggyu Lee and Taesup Moon. Proceedings of Neural Information Processing Systems (NeurIPS), December 2019

Fooling neural network interpretations via adversarial model manipulation. Juyeon Heo, Sunghwan Joo, and Taesup Moon. Proceedings of Neural Information Processing Systems (NeurIPS), December 2019

Hoang DT, Song J, Periwal V, and Jo J. Network inference in stochastic systems from neurons to currencies: Improved performance at small sample size, Phys Rev E, 99:023311 (2019)
Song J, Marsili M, and Jo J. Resolution and relevance trade-offs in deep learning, Journal of Statistical Mechanics, 12:123406 (2018)
Hoang DT, Jo J and Periwal V. Data-driven inference of hidden nodes in networks, Phys Rev E, 99:042114 (2019)
Cubero RJ, Jo J, Marsili M, Roudi Y and Song J. Statistical criticality arises in most informative representations, Journal of Statistical Mechanics, 6:063402 (2019)
Xu J and Jo J. Immunological recognition by articial neural networks, Journal of Korean Physical Society, 73:1908-1917 (2018)
Dynamics Inference from Time Series Data, NRF, 2019.06.01 - 2022.02.28

Characterization of brain network supporting episodic memory in the absence of one medial temporal lobe.

Jeong W, Lee H, Kim JS, Chung CK.

Hum Brain Mapp. 2019 May;40(7):2188-2199.
Direct Stimulation of Human Hippocampus During Verbal Associative Encoding Enhances Subsequent Memory Recollection.

Jun S, Kim JS, Chung CK.

Front Hum Neurosci. 2019 Feb 5;13:23.
Neural basis of episodic memory in the intermediate term after medial temporal lobe resection.

Jeong W, Lee H, Kim JS, Chung CK.

J Neurosurg. 2018 Oct 26;131(3):790-798.
Postoperative seizure outcome-guided machine learning for interictal electrocorticography in neocortical epilepsy.

Park SC, Chung CK.

J Neurophysiol. 2018 Jun 1;119(6):2265-2275.
Disrupted Resting State Network of Fibromyalgia in Theta frequency.

Choe MK, Lim M, Kim JS, Lee DS, Chung CK.

Sci Rep. 2018 Feb 1;8(1):2064.
감각운동통합 상지 제어 뇌-컴퓨터 인터페이스 개발, 연구재단, 2016-2020
작업기억의 기전, 연구재단, 2018-2020

Park HR, Kim IH, Kang H, McCairn KW, Lee DS, Kim BN, Kim DG, Paek SH.Electrophysiological and imaging evidence of sustained inhibition in limbic and frontal networks following deep brain stimulation for treatment refractory obsessive compulsive disorder.PLoS One. 2019 Jul 19;14(7):e0219578. doi: 10.1371/journal.pone.0219578. eCollection 2019
Yi HG, Jeong YH, Kim Y, Choi YJ, Moon YE, Park SH, Kang KS, Jang J, Youn H, Paek SH. Cho DW. A bioprinted human-glioblastoma-on-a-chip for the identification of patient-specific responses to chemoradiotherapy. Nat Biomed Eng. 2019 Mar 18. doi: 10.1038/s41551-019-0363-x.
Choi SH, Kim YB, Paek SH, Cho ZH.Papez Circuit Observed by in vivo Human Brain With 7.0T MRI Super-Resolution Track Density Imaging and Track Tracing.Front Neuroanat. 2019 Feb 18;13:17. doi: 10.3389/fnana.2019.00017. eCollection 2019.
Choi H, Ha S, Im HJ, Paek SH, Lee DS. Refining diagnosis of Parkinson's disease with deep learning-based interpretation of dopamine transporter imaging. Neuroimage Clin. 2017 Sep 10;16:586-594. doi: 10.1016/j.nicl.2017.09.010. eCollection 2017. PMID:28971009
Jung YJ, Kim HJ, Jeon BS, Park H, Lee WW, Paek SH.An 8-Year Follow-up on the Effect of Subthalamic Nucleus Deep Brain Stimulation on Pain in Parkinson Disease.JAMA Neurol. 2015 Mar 23. doi: 10.1001/jamaneurol.2015.8.
미래뇌융합기술개발사업 위탁과제
(과제명: 영장류 이식 환경 구축 및 개발된 시스템의 이식후 성능평가, 연구비 지원기관: 과학기술정보통신부, 연구수행기간: 2020년 1월 1일-2022년 12월 31일)

기계학습 기반의 음성 분석으로 자살 위험 예측

Kwon, D., & Oh, S. (2019). The number of letters in number words influences the response time in numerical comparison tasks: Evidence using Korean number words. Attention, Perception, & Psychophysics, 81(8), 2612-2618.
Ryu, D., & Oh, S. (2018). The effect of good continuation on the contact order judgment of causal events. Journal of Vision, 18(11), 5-5.
Lee, H., & Oh, S. (2016). How directional change in reading/writing habits relates to directional change in displayed pictures. Laterality: Asymmetries of Body, Brain and Cognition, 21(1), 1-11.
Oh, S. (2013). Eyes can switch finger stroke. Perception, 42(6), 681–684.
Oh S. (2011). The eyeglass reversal. Attention, Perception & Psychophysics. 73, 1336-1343.
Baby mind: 아기 모사형 인공지능 개발
서울대학교 얼굴 데이터베이스 구축
미술감상에서 감상자 자세

Kang MS, Choi TY, Ryu HG, Lee D, Lee SH, Choi SY*, Kim KT*. Autism-like behavior caused by deletion of vaccinia-related kinase 3 is improved by TrkB stimulation. J Exp Med. 2017 Oct 2;214(10):2947-2966. doi: 10.1084/jem.20160974.
Choi TY, Lee SH, Kim YJ, Bae JR, Lee KM, Jo Y, Kim SJ, Lee AR, Choi S, Choi LM, Bang SH, Song MR, Chung J, Lee KJ, Kim SH, Park CS, Choi SY. Cereblon maintains synaptic and cognitive function by regulating BK channel. J Neurosci. 2018 Apr 4;38(14):3571-3583. doi: 10.1523/JNEUROSCI.2081-17.2018.
Noh K, Lee H, Choi TY, Joo Y, Kim SJ, Kim H, Kim JY, Jahng JW, Lee S*, Choi SY*, Lee SJ*. Negr1 modulates anxiety- and depression-like behaviors via interaction with the LIF receptor and Lcn-2 expression. Mol Psychiatry. 2019 Aug;24(8):1189-1205. doi: 10.1038/s41380-018-0347-3.
Park SW, Kim J, Kang M, Lee W, Park BS, Kim H, Choi SY, Yang S, Ahn JH, Yang S. Epidermal electrotherapy for epilepsy. Small. 2018 Jul;14(30):e1801732. doi: 10.1002/smll.201801732.
An H, Cha KM, Choi SY, Shin HC. Data compression of excitatory postsynaptic potentials. Electronics Lett. 2015 Aug 31; 51(18):1407-1409. doi: 10.1049/el.2015.1133.
대뇌피질 신경회로의 기능적 다양성 및 발달기전 규명을 통한 뇌기능 이상 해법 도출 (과학기술정보통신부/중견연구자지원사업) 2016.06.01.-2019.05.31
Ex vivo 기반 해마체 신경망 다채널 분석 기술 개발 (과학기술정보통신부/뇌과학원천기술개발사업) 2013.05.01-2016.04.30

Ahn, W.-Y., Kishida, K. T., Gu, X., Lohrenz, T., Harvey, A. H., Alford, J. R., Smith, K. B., Yaffe, G., Hibbing, J. R., Dayan, P., & Montague, P. R. (2014) Nonpolitical images evoke neural predictors of political ideology. Current Biology, 24, 1-7.
Ahn, W.-Y., Haines, N., & Zhang, L. (2017) Revealing neuro-computational mechanisms of reinforcement learning and decision-making with the hBayesDM package. Computational Psychiatry, 1:1.
Ahn, W.-Y. & Vassileva, J. (2016) Machine learning identifies substance-specific behavioral markers for heroin and amphetamine dependence. Drug and Alcohol Dependence, 161, 247-257.
Aylward, J., Valton, V., Ahn, W. Y., Bond, R. L., Dayan, P., Roiser, J. P., & Robinson, O. J. (2019). Altered learning under uncertainty in unmedicated mood and anxiety disorders. Nature Human Behaviour, 3(10), 1116-1123.
Yang, J., Pitt, M. A., Ahn, W. Y., & Myung, J. I. (in press) ADOpy: A Python Package for Adaptive Design Optimization. Behavior Research Methods.
  기계학습을 이용한 빠르고 높은 신뢰도의 멀티모달 금연 표지 개발, 한국연구재단 (연구책임자), 2017-2022년
작업기억-의사결정 상호작용의 뇌신경망에 관한 통합적 연구, 한국연구재단 (공동연구자), 2018-2020년
뇌영상기법과 기계학습을 이용한 비정상적 의사결정의 신경계산학적 기전 연구, 서울대학교 창의선도 신진 연구자 지원사업 (연구책임자), 2019-2022년

Generation of PET attenuation map for whole-body time-of-flight 18F-FDG PET/MRI using a deep neural network trained with simultaneously reconstructed activity and attenuation maps. J Nucl Med. 2019 Aug;60(8):1183-1189.
Improving the accuracy of simultaneously reconstructed activity and attenuation maps using deep learning. J Nucl Med. 2018 Oct;59(10):1624-1629.
Deep-dose: a voxel dose estimation method using deep convolutional neural network for personalized internal dosimetry. Sci Rep. 2019; 9:10308.
Measurement of glomerular filtration rate using quantitative SPECT/CT and deep-learning-based kidney segmentation. Sci Rep. 2019;9:4223.
r amyloid PET using a deep learning approach. Hum Brain Mapp. 2018 May 11;39(9):3769–3778.
뇌질환 임상연구를 위한 7T MR-Compatible PET System 개발, 과학기술
정보통신부, 2014.07 - 2019.04
차세대 초저선량 PET 시스템 핵심 기술 개발, 과학기술 정보통신부, 2016.06 - 2021.03

Answerer in questioner's mind: Information theoretic approach to goal-oriented visual dialog, S.-W. Lee, Y.-J. Heo, B.-T. Zhang, The 32nd Annual Conference on Neural Information Processing Systems (NIPS 2018), (Spotlight)
Bilinear attention networks, J.-H. Kim, J. Jun, B.-T. Zhang, The 32nd Annual Conference on Neural Information Processing Systems (NIPS 2018)
Overcoming catastrophic forgetting by incremental moment matching, S.-W. Lee, J.-H. Kim, J. Jun, J.-W. Ha, and B.-T. Zhang, The 31st Annual Conference on Neural Information Processing Systems (NIPS 2017)
Multimodal residual learning for visual QA, J.-H. Kim, S.-W. Lee, D.-H. Kwak, M.-O. Heo, J. Kim, J.-W. Ha, and B.-T. Zhang, In The 30th Annual Conference on Neural Information Processing Systems (NIPS 2016)

Sungkyu Jung, Myung Hee Lee and Jeongyoun Ahn (2018). “On the number of principal components in high dimensions,” Biometrika 105(2), 389-402.
Sungkyu Jung, Jeongyoun Ahn, and Yongho Jeon (2019). “Penalized Orthogonal Iteration for Sparse Estimation of Generalized Eigenvalue Problem” Journal of Computational and Graphical Statistics. 28(3) 710-721.
Gen Li and Sungkyu Jung (2017). “Incorporating Covariates into Integrated Factor Analysis of Multi-View Data,” Biometrics 73 (4), 1433-1442.
Byungwon Kim, Stephan Huckemann, Joern Schulz, and Sungkyu Jung (2019). “Small sphere distributions for directional data with application to medical imaging”, Scandinavian Journal of Statistics. 46(4) 1047-1071.

Shin D, Ji S, Lee D, Lee J, Oh SH, Lee J*,
Deep Reinforcement Learning Designed RF Pulse: DeepRF_SLR
arXiv. 2019 Dec;1912.09015.
Jung W*, Steffen Bollmann*, Lee J*
[REVIEW] Overview of quantitative susceptibility mapping using deep learning – Current status, challenges and opportunities
arXiv. 2019 Dec;1912.05410.
Jung W, Yoon J, Ji S, Choi JY, Kim JM, Nam Y, Kim EY, Lee J*
Exploring linearity of deep neural network trained QSM: QSMnet+
Neuroimage 2020 in press
Lee J, Lee D, Choi JY, Shin D, Shin HG, Lee J*
Artificial neural network for myelin water imaging
Magn Res Med 2020 83(5):1875-1883
Yoon J, Gong E, Chatnuntawech I, Bilgic B, Lee J, Jung W, Ko J, Jung H, Setsompop K, Zaharchuk G, Kim EY, Pauly J, Lee J*
Quantitative susceptibility mapping using deep neural network: QSMnet
NeuroImage 2018 179:199-206

"FlexLearn: Fast and Highly Efficient Brain Simulations Using Flexible On-Chip Learning", Eunjin Baek, Hunjun Lee, Youngsok Kim, and Jangwoo Kim, ACM/IEEE International Symposium on Microarchitecture (MICRO), Oct 2019
"MnnFast: A Fast and Scalable System Architecture for Memory-Augmented Neural Networks", Hanhwi Jang, Joonsung Kim, Jae-Eon Jo, Jaewon Lee, and Jangwoo Kim, ACM/IEEE International Symposium on Computer Architecture (ISCA), Jun 2019
"Flexon: A Flexible Digital Neuron for Efficient Spiking Neural Network Simulations"
Dayeol Lee, Gwangmu Lee, Dongup Kwon, Sunghwa Lee, Youngsok Kim, and Jangwoo Kim, ACM/IEEE International Symposium on Computer Architecture (ISCA), Jun 2018
"μLayer: Low Latency On-Device Inference Using Cooperative Single-Layer Acceleration and Processor-Friendly Quantization", Youngsok Kim, Joonsung Kim, Dongju Chae, Daehyun Kim, and Jangwoo Kim, ACM European Conference on Computer Systems (EuroSys), Mar 2019
"FIDR: A Scalable Storage System for Fine-Grain Inline Data Reduction with Efficient Memory Handling", Mohammadamin Ajdari, Wonsik Lee, Pyeongsu Park, Joonsung Kim, and Jangwoo Kim, ACM/IEEE International Symposium on Microarchitecture (MICRO), Oct 2019
인공지능 가상머신: 이종 인공지능의 동시, 고속, 독립 실행을 위한 컴퓨터 구조/삼성미래기술육성사업/2019.6-2022.5
이종 스파이크 뉴런 기반의 인간 두뇌 규모 시뮬레이션을 위한 프로세서 및 시스템 개발/한국연구재단/2017.3-2021.2
대규모 뉴럴 프로세싱을 위한 FPGA 기반의 확장형 시스템 개발/삼성전자/2017.11-2020.10

"The sexual brain, genes, and cognition: A machine-predicted brain sex score explains individual differences in cognitive intelligence and genetic influence in young children." Human Brain Mapping
"Association of Genome-wide Polygenic Scores for Multiple Psychiatric and Common Traits Identify Preadolescent Youth with Risk for Suicide." JAMA Network Open
"Maturity of gray matter structures and white matter connectomes, and their relationship with psychiatric symptoms in youth." Human Brain Mapping
"Machine learning prediction of incidence of Alzheimer’s disease using large-scale administrative health data." NPJ Digital Medicine
"Diagnosis and prognosis of Alzheimer's disease using brain morphometry and white matter connectomes." Neuroimage-Clinical
"Associations between brain structure and connectivity in infants and exposure to selective serotonin reuptake inhibitors during pregnancy. " JAMA pediatrics
"The Effects of Obstructive Sleep Apnea Syndrome on the Dentate Gyrus and Learning and Memory in Children.'" The Journal of Neuroscience
"Clinically anxious individuals show disrupted feedback between inferior frontal gyrus and prefrontal-limbic control circuit."  Journal of Neuroscience
"Neural correlates of aggression in medication-naive children with ADHD: multivariate analysis of morphometry and tractography."  Neuropsychopharmacology
"Hyper-reactive human ventral tegmental area and aberrant mesocorticolimbic connectivity in overgeneralization of fear in generalized anxiety disorder."  Journal of Neuroscience
"Circuit-wide structural and functional measures predict ventromedial prefrontal cortex fear generalization: implications for generalized anxiety disorder."  Journal of Neuroscience

Byeong-Min Lee*, Chisong Lee*, Shayan Fakhraei Lahiji, Ui-Won Jung , Gehoon Chung#, Hyungil Jung# Dissolving Microneedles for Rapid and Painless Local Anesthesia. Pharmaceutics (2020) 12(4):366.

J. Park, J. Lee, and D. Jeon, “A 65-nm Neuromorphic Image Classification Processor With Energy-Efficient Training Through Direct Spike-Only Feedback,” IEEE Journal of Solid-State Circuits (JSSC), 2020.
S. Moon, K. Shin, and D. Jeon, “Enhancing Reliability of Analog Neural Network Processors,” IEEE Transactions on VLSI Systems (TVLSI), 2019.
J. Park, Y. Kwon, Y. Park, and D. Jeon, “Microarchitecture-Aware Code Generation for Deep Learning on Single-ISA Heterogeneous Multi-Core Mobile Processors,” IEEE Access, 2019.
D. Jeon, Q. Dong, Y. Kim, X. Wang, S. Chen, H. Yu, D. Blaauw, and D. Sylvester, “A 23-mW Face Recognition Processor with Mostly-Read 5T Memory in 40-nm CMOS,” IEEE Journal of Solid-State Circuits (JSSC), 2017.
D. Jeon, N. Ickes, P. Raina, H.-C. Wang, and A. P. Chandrakasan, “A 0.6V, 8mW 3D Vision Processor for a Navigation Device for the Visually Impaired,” IEEE International Solid-State Circuits Conference (ISSCC), 2016.
자가 학습이 가능한 초저전력 혼성신호 뉴로모픽 프로세서 설계, 과학기술정보통신부, 2019~2022.
고효율 딥러닝 하드웨어 가속기 개발, 한국과학기술연구원, 2019~2021.
모바일 시스템을 위한 저전력 머신 러닝 하드웨어 가속기 개발, 과학기술정보통신부, 2016~2019.