更改

根据一篇综述<ref name="scholarpedia">{{cite journal | last1 = Schmidhuber | first1 = Jürgen | authorlink = Jürgen Schmidhuber | year = 2015 | title = Deep Learning | journal = Scholarpedia | volume = 10 | issue = 11 | page = 32832 | doi = 10.4249/scholarpedia.32832 | df = dmy-all | bibcode = 2015SchpJ..1032832S | doi-access = free }}</ref>，“深度学习”这种表述是在1986年<ref name="dechter1986">[[Rina Dechter]] (1986). Learning while searching in constraint-satisfaction problems. University of California, Computer Science Department, Cognitive Systems Laboratory.[https://www.researchgate.net/publication/221605378_Learning_While_Searching_in_Constraint-Satisfaction-Problems Online]</ref>被里纳·德克特引入到机器学习领域的，并在2000年伊克尔·艾森贝格和他的同事将其引入人工神经网络后获得了关注。<ref name="aizenberg2000">Igor Aizenberg, Naum N. Aizenberg, Joos P.L. Vandewalle (2000). Multi-Valued and Universal Binary Neurons: Theory, Learning and Applications. Springer Science & Business Media.</ref> The first functional Deep Learning networks were published by [[Alexey Grigorevich Ivakhnenko]] and V. G. Lapa in 1965.<ref>{{Cite book|title=Cybernetic Predicting Devices|last=Ivakhnenko|first=Alexey|publisher=Naukova Dumka|year=1965|isbn=|location=Kiev|pages=}}</ref>

根据一篇综述<ref name="scholarpedia">{{cite journal | last1 = Schmidhuber | first1 = Jürgen | authorlink = Jürgen Schmidhuber | year = 2015 | title = Deep Learning | journal = Scholarpedia | volume = 10 | issue = 11 | page = 32832 | doi = 10.4249/scholarpedia.32832 | df = dmy-all | bibcode = 2015SchpJ..1032832S | doi-access = free }}</ref>，“深度学习”这种表述是在1986年<ref name="dechter1986">Rina Dechter(1986). Learning while searching in constraint-satisfaction problems. University of California, Computer Science Department, Cognitive Systems Laboratory.[https://www.researchgate.net/publication/221605378_Learning_While_Searching_in_Constraint-Satisfaction-Problems Online]</ref>被Rina Dechter特引入到机器学习领域的，并在2000年Igor Aizenberg和他的同事将其引入人工神经网络后获得了关注。<ref name="aizenberg2000">Igor Aizenberg, Naum N. Aizenberg, Joos P.L. Vandewalle (2000). Multi-Valued and Universal Binary Neurons: Theory, Learning and Applications. Springer Science & Business Media.</ref> Alexey Grigorevich Ivakhnenko 和 V. G. Lapa 于 1965 年发表了第一个功能性深度学习网络。<ref>{{Cite book|title=Cybernetic Predicting Devices|last=Ivakhnenko|first=Alexey|publisher=Naukova Dumka|year=1965|isbn=|location=Kiev|pages=}}</ref>

深度学习通常使用'卷积神经网络 ConvolutionalNeural Networks CNNs''' ，其起源可以追溯到1980年由福岛邦彦引进的新认知机。<ref name="FUKU1980">{{cite journal | last1 = Fukushima | first1 = K. | year = 1980 | title = Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position | url = | journal = Biological Cybernetics | volume = 36 | issue = 4| pages = 193–202 | doi=10.1007/bf00344251 | pmid=7370364}}</ref> 1989年扬·勒丘恩(Yann LeCun)和他的同事将反向传播算法应用于这样的架构。在21世纪初，在一项工业应用中，CNNs已经处理了美国大约10% 到20%的签发支票。<ref name="lecun2016slides">[[Yann LeCun]] (2016). Slides on Deep Learning [https://indico.cern.ch/event/510372/ Online] {{webarchive|url=https://web.archive.org/web/20160423021403/https://indico.cern.ch/event/510372/ |date=23 April 2016 }}</ref>

深度学习通常使用'卷积神经网络 ConvolutionalNeural Networks CNNs''' ，其起源可以追溯到1980年由福岛邦彦引进的新认知机。<ref name="FUKU1980">{{cite journal | last1 = Fukushima | first1 = K. | year = 1980 | title = Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position | url = | journal = Biological Cybernetics | volume = 36 | issue = 4| pages = 193–202 | doi=10.1007/bf00344251 | pmid=7370364}}</ref> 1989年扬·勒丘恩(Yann LeCun)和他的同事将反向传播算法应用于这样的架构。在21世纪初，在一项工业应用中，CNNs已经处理了美国大约10% 到20%的签发支票。<ref name="lecun2016slides">Yann LeCun (2016). Slides on Deep Learning [https://indico.cern.ch/event/510372/ Online]

2016年Deepmind 的“AlphaGo Lee”使用了有12个卷积层的 CNNs 和强化学习，击败了一个顶级围棋冠军。<ref name="Nature2017">{{cite journal |first1=David |last1=Silver|author-link1=David Silver (programmer)|first2= Julian|last2= Schrittwieser|first3= Karen|last3= Simonyan|first4= Ioannis|last4= Antonoglou|first5= Aja|last5= Huang|author-link5=Aja Huang|first6=Arthur|last6= Guez|first7= Thomas|last7= Hubert|first8= Lucas|last8= Baker|first9= Matthew|last9= Lai|first10= Adrian|last10= Bolton|first11= Yutian|last11= Chen|author-link11=Chen Yutian|first12= Timothy|last12= Lillicrap|first13=Hui|last13= Fan|author-link13=Fan Hui|first14= Laurent|last14= Sifre|first15= George van den|last15= Driessche|first16= Thore|last16= Graepel|first17= Demis|last17= Hassabis |author-link17=Demis Hassabis|title=Mastering the game of Go without human knowledge|journal=[[Nature (journal)|Nature]]|issn= 0028-0836|pages=354–359|volume =550|issue =7676|doi =10.1038/nature24270|pmid=29052630|date=19 October 2017|quote=AlphaGo Lee... 12 convolutional layers|bibcode=2017Natur.550..354S|url=http://discovery.ucl.ac.uk/10045895/1/agz_unformatted_nature.pdf}}{{closed access}}</ref>

2016年Deepmind 的“AlphaGo Lee”使用了有12个卷积层的 CNNs 和强化学习，击败了一个顶级围棋冠军。<ref name="Nature2017">{{cite journal |first1=David |last1=Silver|author-link1=David Silver (programmer)|first2= Julian|last2= Schrittwieser|first3= Karen|last3= Simonyan|first4= Ioannis|last4= Antonoglou|first5= Aja|last5= Huang|author-link5=Aja Huang|first6=Arthur|last6= Guez|first7= Thomas|last7= Hubert|first8= Lucas|last8= Baker|first9= Matthew|last9= Lai|first10= Adrian|last10= Bolton|first11= Yutian|last11= Chen|author-link11=Chen Yutian|first12= Timothy|last12= Lillicrap|first13=Hui|last13= Fan|author-link13=Fan Hui|first14= Laurent|last14= Sifre|first15= George van den|last15= Driessche|first16= Thore|last16= Graepel|first17= Demis|last17= Hassabis |author-link17=Demis Hassabis|title=Mastering the game of Go without human knowledge|journal=Nature |issn= 0028-0836|pages=354–359|volume =550|issue =7676|doi =10.1038/nature24270|pmid=29052630|date=19 October 2017|quote=AlphaGo Lee... 12 convolutional layers|bibcode=2017Natur.550..354S|url=http://discovery.ucl.ac.uk/10045895/1/agz_unformatted_nature.pdf}}</ref>

 

====深层循环（递归）神经网络 ====

====深层循环（递归）神经网络 ====