更改
跳到导航
跳到搜索
第294行:
第294行:
− +
→神经图灵机(Neural Turing machines)
===== 神经图灵机(Neural Turing machines) =====
===== 神经图灵机(Neural Turing machines) =====
神经图灵机<ref name="Graves, Alex 14102">Graves, Alex, Greg Wayne, and Ivo Danihelka. [https://arxiv.org/abs/1410.5401 "Neural Turing Machines."] (2014).</ref>将LSTM网络与外部记忆资源结合,这样他们可以通过注意过程相互影响。这种组合系统和[https://en.wikipedia.org/wiki/Turing_machine 图灵机]相似但是端到端可微,允许使用[https://en.wikipedia.org/wiki/Gradient_descent 梯度下降]有效训练 。初步结果表明神经图灵机可以推断简单算法,如复制,排序和从输入输出例子的联想回忆。
神经图灵机<ref name="Graves, Alex 14102">Graves, Alex, Greg Wayne, and Ivo Danihelka. [https://arxiv.org/abs/1410.5401 "Neural Turing Machines."] (2014).</ref>将LSTM网络与外部记忆资源结合,这样他们可以通过注意过程相互影响。这种组合系统和[https://en.wikipedia.org/wiki/Turing_machine 图灵机]相似但是端到端可微,允许使用[https://en.wikipedia.org/wiki/Gradient_descent 梯度下降]有效训练 。初步结果表明神经图灵机可以推断简单算法,如复制,排序和从输入输出例子的联想回忆。
[https://en.wikipedia.org/wiki/Differentiable_neural_computer 可微神经计算机](DNC)是一个NTM的延伸。他们在序列处理任务中表现超过神经图灵机,长短期记忆系统和记忆网络。<ref name=":02">{{Cite journal|url=https://www.wired.co.uk/article/deepmind-ai-tube-london-underground|title=DeepMind's AI learned to ride the London Underground using human-like reason and memory|last=Burgess|first=Matt|journal=WIRED UK|language=en-GB|access-date=2016-10-19}}</ref><ref>{{Cite journal|url=https://www.pcmag.com/news/348701/deepmind-ai-learns-to-navigate-london-tube|title=DeepMind AI 'Learns' to Navigate London Tube|journal=PCMAG|access-date=2016-10-19}}</ref><ref>{{Cite journal|url=https://techcrunch.com/2016/10/13/__trashed-2/|title=DeepMind's differentiable neural computer helps you navigate the subway with its memory|last=Mannes|first=John|journal=TechCrunch|access-date=2016-10-19}}</ref><ref>{{Cite journal|last=Graves|first=Alex|last2=Wayne|first2=Greg|last3=Reynolds|first3=Malcolm|last4=Harley|first4=Tim|last5=Danihelka|first5=Ivo|last6=Grabska-Barwińska|first6=Agnieszka|last7=Colmenarejo|first7=Sergio Gómez|last8=Grefenstette|first8=Edward|last9=Ramalho|first9=Tiago|date=2016-10-12|title=Hybrid computing using a neural network with dynamic external memory|url=http://www.nature.com/nature/journal/vaop/ncurrent/full/nature20101.html|journal=Nature|language=en|volume=538|issue=7626|pages=471–476}}</ref><ref>{{Cite journal|url=https://deepmind.com/blog/differentiable-neural-computers/|title=Differentiable neural computers {{!}} DeepMind|journal=DeepMind|access-date=2016-10-19}}</ref>
[https://en.wikipedia.org/wiki/Differentiable_neural_computer 可微神经计算机](DNC)是一个NTM的延伸。他们在序列处理任务中表现超过神经图灵机,长短期记忆系统和记忆网络。<ref name=":02">{{Cite journal|url=https://www.wired.co.uk/article/deepmind-ai-tube-london-underground|title=DeepMind's AI learned to ride the London Underground using human-like reason and memory|last=Burgess|first=Matt|journal=WIRED UK|language=en-GB|access-date=2016-10-19}}</ref><ref>{{Cite journal|url=https://www.pcmag.com/news/348701/deepmind-ai-learns-to-navigate-london-tube|title=DeepMind AI 'Learns' to Navigate London Tube|journal=PCMAG|access-date=2016-10-19}}</ref><ref>{{Cite journal|url=https://techcrunch.com/2016/10/13/__trashed-2/|title=DeepMind's differentiable neural computer helps you navigate the subway with its memory|last=Mannes|first=John|journal=TechCrunch|access-date=2016-10-19}}</ref><ref>{{Cite journal|last=Graves|first=Alex|last2=Wayne|first2=Greg|last3=Reynolds|first3=Malcolm|last4=Harley|first4=Tim|last5=Danihelka|first5=Ivo|last6=Grabska-Barwińska|first6=Agnieszka|last7=Colmenarejo|first7=Sergio Gómez|last8=Grefenstette|first8=Edward|last9=Ramalho|first9=Tiago|date=2016-10-12|title=Hybrid computing using a neural network with dynamic external memory|url=http://www.nature.com/nature/journal/vaop/ncurrent/full/nature20101.html|journal=Nature|language=en|volume=538|issue=7626|pages=471–476}}</ref><ref>{{Cite journal|url=https://deepmind.com/blog/differentiable-neural-computers/|title=Differentiable neural computers, DeepMind|journal=DeepMind|access-date=2016-10-19}}</ref>
==== 语义哈希(Semantic hashing )====
==== 语义哈希(Semantic hashing )====