370
个编辑
更改
跳到导航
跳到搜索
第683行：
第683行： − − ==See also== − − 另请参阅 − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − ===Applications=== − − 申请 − − − − − − − − − − − − − − − − − − − − − − − − − − + − − − − − − − − ===History=== − − 历史 − − − − − − − − − − − − − − − − + − − − − − − − − ===Theory=== − − 理论 − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − + − − − − − − − − ===Concepts=== − − 概念 − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − + − − − − − − − − ==References== − − 参考资料 − + − − − − − − − ===The classic work=== − − 经典之作 − − − − − − − − + − − − − − − − ===Other journal articles=== − − 其他期刊文章 − − − − − − − − − − − + − − − − − − − ===Textbooks on information theory=== − − 信息论教材 − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − + − − − − − − − ===Other books=== − − 其他书籍 − − − − − − − − − − − − − − − − − − − − − − − − − + − − − − − − − ===MOOC on information theory=== − − 信息论大型开放式课程 − + − − − − − − − ==External links== − − 外部链接 − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − − −
无编辑摘要
==See also==
==See also==
{{Portal|Mathematics}}
{{Portal|Mathematics}}
* [[Algorithmic probability]]
* [[Algorithmic probability]]
* [[Bayesian inference]]
* [[Bayesian inference]]
* [[Communication theory]]
* [[Communication theory]]
* [[Constructor theory]] - a generalization of information theory that includes quantum information
* [[Constructor theory]] - a generalization of information theory that includes quantum information
* [[Inductive probability]]
* [[Inductive probability]]
* [[Info-metrics]]
* [[Info-metrics]]
* [[Minimum message length]]
* [[Minimum message length]]
* [[Minimum description length]]
* [[Minimum description length]]
* [[List of important publications in theoretical computer science#Information theory|List of important publications]]
* [[List of important publications in theoretical computer science#Information theory|List of important publications]]
* [[Philosophy of information]]
* [[Philosophy of information]]
===Applications===
===Applications===
{{div col|colwidth=20em}}
{{div col|colwidth=20em}}
* [[Active networking]]
* [[Active networking]]
* [[Cryptanalysis]]
* [[Cryptanalysis]]
* [[Cryptography]]
* [[Cryptography]]
* [[Cybernetics]]
* [[Cybernetics]]
* [[Entropy in thermodynamics and information theory]]
* [[Entropy in thermodynamics and information theory]]
* [[Gambling]]
* [[Gambling]]
* [[Intelligence (information gathering)]]
* [[Intelligence (information gathering)]]
* [[reflection seismology|Seismic exploration]]
* [[reflection seismology|Seismic exploration]]
{{div col end}}
{{div col end}}
===历史===
===History===
{{div col|colwidth=20em}}
{{div col|colwidth=20em}}
* [[Ralph Hartley|Hartley, R.V.L.]]
* [[Ralph Hartley|Hartley, R.V.L.]]
* [[History of information theory]]
* [[History of information theory]]
* [[Claude Elwood Shannon|Shannon, C.E.]]
* [[Claude Elwood Shannon|Shannon, C.E.]]
* [[Timeline of information theory]]
* [[Timeline of information theory]]
* [[Hubert Yockey|Yockey, H.P.]]
* [[Hubert Yockey|Yockey, H.P.]]
{{div col end}}
{{div col end}}
===理论===
===Theory===
{{div col|colwidth=20em}}
{{div col|colwidth=20em}}
* [[Coding theory]]
* [[Coding theory]]
* [[Detection theory]]
* [[Detection theory]]
* [[Estimation theory]]
* [[Estimation theory]]
* [[Fisher information]]
* [[Fisher information]]
* [[Information algebra]]
* [[Information algebra]]
* [[Information asymmetry]]
* [[Information asymmetry]]
* [[Information field theory]]
* [[Information field theory]]
* [[Information geometry]]
* [[Information geometry]]
* [[Information theory and measure theory]]
* [[Information theory and measure theory]]
* [[Kolmogorov complexity]]
* [[Kolmogorov complexity]]
* [[List of unsolved problems in information theory]]
* [[List of unsolved problems in information theory]]
* [[Logic of information]]
* [[Logic of information]]
* [[Network coding]]
* [[Network coding]]
* [[Philosophy of information]]
* [[Philosophy of information]]
* [[Quantum information science]]
* [[Quantum information science]]
* [[Source coding]]
* [[Source coding]]
{{div col end}}
{{div col end}}
===概念===
===Concepts===
{{div col|colwidth=20em}}
{{div col|colwidth=20em}}
* [[Ban (unit)]]
* [[Ban (unit)]]
* [[Channel capacity]]
* [[Channel capacity]]
* [[Communication channel]]
* [[Communication channel]]
* [[Communication source]]
* [[Communication source]]
* [[Conditional entropy]]
* [[Conditional entropy]]
* [[Covert channel]]
* [[Covert channel]]
* [[Data compression]]
* [[Data compression]]
* Decoder
* Decoder
* [[Differential entropy]]
* [[Differential entropy]]
* [[Fungible information]]
* [[Fungible information]]
* [[Information fluctuation complexity]]
* [[Information fluctuation complexity]]
* [[Information entropy]]
* [[Information entropy]]
* [[Joint entropy]]
* [[Joint entropy]]
* [[Kullback–Leibler divergence]]
* [[Kullback–Leibler divergence]]
* [[Mutual information]]
* [[Mutual information]]
* [[Pointwise mutual information]] (PMI)
* [[Pointwise mutual information]] (PMI)
* [[Receiver (information theory)]]
* [[Receiver (information theory)]]
* [[Redundancy (information theory)|Redundancy]]
* [[Redundancy (information theory)|Redundancy]]
* [[Rényi entropy]]
* [[Rényi entropy]]
* [[Self-information]]
* [[Self-information]]
* [[Unicity distance]]
* [[Unicity distance]]
* [[Variety (cybernetics)|Variety]]
* [[Variety (cybernetics)|Variety]]
* [[Hamming distance]]
* [[Hamming distance]]
{{div col end}}
{{div col end}}
==参考资料==
==References==
{{Reflist}}
{{Reflist}}
===经典之作===
===The classic work===
{{refbegin}}
{{refbegin}}
* [[Claude Elwood Shannon|Shannon, C.E.]] (1948), "[[A Mathematical Theory of Communication]]", ''Bell System Technical Journal'', 27, pp. 379–423 & 623–656, July & October, 1948. [http://math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf PDF.] <br />[http://cm.bell-labs.com/cm/ms/what/shannonday/paper.html Notes and other formats.]
* [[Claude Elwood Shannon|Shannon, C.E.]] (1948), "[[A Mathematical Theory of Communication]]", ''Bell System Technical Journal'', 27, pp. 379–423 & 623–656, July & October, 1948. [http://math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf PDF.] <br />[http://cm.bell-labs.com/cm/ms/what/shannonday/paper.html Notes and other formats.]
* R.V.L. Hartley, [http://www.dotrose.com/etext/90_Miscellaneous/transmission_of_information_1928b.pdf "Transmission of Information"], ''Bell System Technical Journal'', July 1928
* R.V.L. Hartley, [http://www.dotrose.com/etext/90_Miscellaneous/transmission_of_information_1928b.pdf "Transmission of Information"], ''Bell System Technical Journal'', July 1928
* [[Andrey Kolmogorov]] (1968), "[https://www.tandfonline.com/doi/pdf/10.1080/00207166808803030 Three approaches to the quantitative definition of information]" in International Journal of Computer Mathematics.
* [[Andrey Kolmogorov]] (1968), "[https://www.tandfonline.com/doi/pdf/10.1080/00207166808803030 Three approaches to the quantitative definition of information]" in International Journal of Computer Mathematics.
{{refend}}
{{refend}}
===其他期刊文章===
===Other journal articles===
{{refbegin}}
{{refbegin}}
* J. L. Kelly, Jr., [http://betbubbles.com/wp-content/uploads/2017/07/kelly.pdf Betbubbles.com]{{Dead link|date=January 2020 |bot=InternetArchiveBot |fix-attempted=yes }}, "A New Interpretation of Information Rate" ''Bell System Technical Journal'', Vol. 35, July 1956, pp. 917–26.
* J. L. Kelly, Jr., [http://betbubbles.com/wp-content/uploads/2017/07/kelly.pdf Betbubbles.com]{{Dead link|date=January 2020 |bot=InternetArchiveBot |fix-attempted=yes }}, "A New Interpretation of Information Rate" ''Bell System Technical Journal'', Vol. 35, July 1956, pp. 917–26.
* R. Landauer, [http://ieeexplore.ieee.org/search/wrapper.jsp?arnumber=615478 IEEE.org], "Information is Physical" ''Proc. Workshop on Physics and Computation PhysComp'92'' (IEEE Comp. Sci.Press, Los Alamitos, 1993) pp. 1–4.
* R. Landauer, [http://ieeexplore.ieee.org/search/wrapper.jsp?arnumber=615478 IEEE.org], "Information is Physical" ''Proc. Workshop on Physics and Computation PhysComp'92'' (IEEE Comp. Sci.Press, Los Alamitos, 1993) pp. 1–4.
* {{cite journal | last1 = Landauer | first1 = R. | year = 1961 | title = Irreversibility and Heat Generation in the Computing Process | url = http://www.research.ibm.com/journal/rd/441/landauerii.pdf | journal = IBM J. Res. Dev. | volume = 5 | issue = 3| pages = 183–191 | doi = 10.1147/rd.53.0183 }}
* {{cite journal | last1 = Landauer | first1 = R. | year = 1961 | title = Irreversibility and Heat Generation in the Computing Process | url = http://www.research.ibm.com/journal/rd/441/landauerii.pdf | journal = IBM J. Res. Dev. | volume = 5 | issue = 3| pages = 183–191 | doi = 10.1147/rd.53.0183 }}
* {{cite arXiv |last=Timme |first=Nicholas|last2=Alford |first2=Wesley|last3=Flecker |first3=Benjamin|last4=Beggs |first4=John M.|date=2012 |title=Multivariate information measures: an experimentalist's perspective |eprint=1111.6857|class=cs.IT}}
* {{cite arXiv |last=Timme |first=Nicholas|last2=Alford |first2=Wesley|last3=Flecker |first3=Benjamin|last4=Beggs |first4=John M.|date=2012 |title=Multivariate information measures: an experimentalist's perspective |eprint=1111.6857|class=cs.IT}}
{{refend}}
{{refend}}
===信息论教材===
===Textbooks on information theory===
{{refbegin}}
{{refbegin}}
* Arndt, C. ''Information Measures, Information and its Description in Science and Engineering'' (Springer Series: Signals and Communication Technology), 2004, {{isbn|978-3-540-40855-0}}
* Arndt, C. ''Information Measures, Information and its Description in Science and Engineering'' (Springer Series: Signals and Communication Technology), 2004, {{isbn|978-3-540-40855-0}}
* Ash, RB. ''Information Theory''. New York: Interscience, 1965. {{isbn|0-470-03445-9}}. New York: Dover 1990. {{isbn|0-486-66521-6}}
* Ash, RB. ''Information Theory''. New York: Interscience, 1965. {{isbn|0-470-03445-9}}. New York: Dover 1990. {{isbn|0-486-66521-6}}
* [[Gallager, R]]. ''Information Theory and Reliable Communication.'' New York: John Wiley and Sons, 1968. {{isbn|0-471-29048-3}}
* [[Gallager, R]]. ''Information Theory and Reliable Communication.'' New York: John Wiley and Sons, 1968. {{isbn|0-471-29048-3}}
* Goldman, S. ''Information Theory''. New York: Prentice Hall, 1953. New York: Dover 1968 {{isbn|0-486-62209-6}}, 2005 {{isbn|0-486-44271-3}}
* Goldman, S. ''Information Theory''. New York: Prentice Hall, 1953. New York: Dover 1968 {{isbn|0-486-62209-6}}, 2005 {{isbn|0-486-44271-3}}
* {{cite book |last1=Cover |first1=Thomas |author-link1=Thomas M. Cover |last2=Thomas |first2=Joy A. |title=Elements of information theory |edition=2nd |location=New York |publisher=[[Wiley-Interscience]] |date=2006 |isbn=0-471-24195-4}}
* {{cite book |last1=Cover |first1=Thomas |author-link1=Thomas M. Cover |last2=Thomas |first2=Joy A. |title=Elements of information theory |edition=2nd |location=New York |publisher=[[Wiley-Interscience]] |date=2006 |isbn=0-471-24195-4}}
* [[Csiszar, I]], Korner, J. ''Information Theory: Coding Theorems for Discrete Memoryless Systems'' Akademiai Kiado: 2nd edition, 1997. {{isbn|963-05-7440-3}}
* [[Csiszar, I]], Korner, J. ''Information Theory: Coding Theorems for Discrete Memoryless Systems'' Akademiai Kiado: 2nd edition, 1997. {{isbn|963-05-7440-3}}
* [[David J. C. MacKay|MacKay, David J. C.]]. ''[http://www.inference.phy.cam.ac.uk/mackay/itila/book.html Information Theory, Inference, and Learning Algorithms]'' Cambridge: Cambridge University Press, 2003. {{isbn|0-521-64298-1}}
* [[David J. C. MacKay|MacKay, David J. C.]]. ''[http://www.inference.phy.cam.ac.uk/mackay/itila/book.html Information Theory, Inference, and Learning Algorithms]'' Cambridge: Cambridge University Press, 2003. {{isbn|0-521-64298-1}}
* Mansuripur, M. ''Introduction to Information Theory''. New York: Prentice Hall, 1987. {{isbn|0-13-484668-0}}
* Mansuripur, M. ''Introduction to Information Theory''. New York: Prentice Hall, 1987. {{isbn|0-13-484668-0}}
* [[Robert McEliece|McEliece, R]]. ''The Theory of Information and Coding". Cambridge, 2002. {{isbn|978-0521831857}}
* [[Robert McEliece|McEliece, R]]. ''The Theory of Information and Coding". Cambridge, 2002. {{isbn|978-0521831857}}
*Pierce, JR. "An introduction to information theory: symbols, signals and noise". Dover (2nd Edition). 1961 (reprinted by Dover 1980).
*Pierce, JR. "An introduction to information theory: symbols, signals and noise". Dover (2nd Edition). 1961 (reprinted by Dover 1980).
* [[Reza, F]]. ''An Introduction to Information Theory''. New York: McGraw-Hill 1961. New York: Dover 1994. {{isbn|0-486-68210-2}}
* [[Reza, F]]. ''An Introduction to Information Theory''. New York: McGraw-Hill 1961. New York: Dover 1994. {{isbn|0-486-68210-2}}
* {{cite book |last1=Shannon |first1=Claude |author-link1=Claude Shannon |last2=Weaver |first2=Warren |author-link2=Warren Weaver |date=1949 |title=The Mathematical Theory of Communication |url=http://monoskop.org/images/b/be/Shannon_Claude_E_Weaver_Warren_The_Mathematical_Theory_of_Communication_1963.pdf |location=[[Urbana, Illinois]] |publisher=[[University of Illinois Press]] |lccn=49-11922 |isbn=0-252-72548-4}}
* {{cite book |last1=Shannon |first1=Claude |author-link1=Claude Shannon |last2=Weaver |first2=Warren |author-link2=Warren Weaver |date=1949 |title=The Mathematical Theory of Communication |url=http://monoskop.org/images/b/be/Shannon_Claude_E_Weaver_Warren_The_Mathematical_Theory_of_Communication_1963.pdf |location=[[Urbana, Illinois]] |publisher=[[University of Illinois Press]] |lccn=49-11922 |isbn=0-252-72548-4}}
* Stone, JV. Chapter 1 of book [http://jim-stone.staff.shef.ac.uk/BookInfoTheory/InfoTheoryBookMain.html "Information Theory: A Tutorial Introduction"], University of Sheffield, England, 2014. {{isbn|978-0956372857}}.
* Stone, JV. Chapter 1 of book [http://jim-stone.staff.shef.ac.uk/BookInfoTheory/InfoTheoryBookMain.html "Information Theory: A Tutorial Introduction"], University of Sheffield, England, 2014. {{isbn|978-0956372857}}.
* Yeung, RW. ''[http://iest2.ie.cuhk.edu.hk/~whyeung/book/ A First Course in Information Theory]'' Kluwer Academic/Plenum Publishers, 2002. {{isbn|0-306-46791-7}}.
* Yeung, RW. ''[http://iest2.ie.cuhk.edu.hk/~whyeung/book/ A First Course in Information Theory]'' Kluwer Academic/Plenum Publishers, 2002. {{isbn|0-306-46791-7}}.
* Yeung, RW. ''[http://iest2.ie.cuhk.edu.hk/~whyeung/book2/ Information Theory and Network Coding]'' Springer 2008, 2002. {{isbn|978-0-387-79233-0}}
* Yeung, RW. ''[http://iest2.ie.cuhk.edu.hk/~whyeung/book2/ Information Theory and Network Coding]'' Springer 2008, 2002. {{isbn|978-0-387-79233-0}}
{{refend}}
{{refend}}
===其他书籍===
===Other books===
{{refbegin}}
{{refbegin}}
* Leon Brillouin, ''Science and Information Theory'', Mineola, N.Y.: Dover, [1956, 1962] 2004. {{isbn|0-486-43918-6}}
* Leon Brillouin, ''Science and Information Theory'', Mineola, N.Y.: Dover, [1956, 1962] 2004. {{isbn|0-486-43918-6}}
* [[James Gleick]], ''[[The Information: A History, a Theory, a Flood]]'', New York: Pantheon, 2011. {{isbn|978-0-375-42372-7}}
* [[James Gleick]], ''[[The Information: A History, a Theory, a Flood]]'', New York: Pantheon, 2011. {{isbn|978-0-375-42372-7}}
* A. I. Khinchin, ''Mathematical Foundations of Information Theory'', New York: Dover, 1957. {{isbn|0-486-60434-9}}
* A. I. Khinchin, ''Mathematical Foundations of Information Theory'', New York: Dover, 1957. {{isbn|0-486-60434-9}}
* H. S. Leff and A. F. Rex, Editors, ''Maxwell's Demon: Entropy, Information, Computing'', Princeton University Press, Princeton, New Jersey (1990). {{isbn|0-691-08727-X}}
* H. S. Leff and A. F. Rex, Editors, ''Maxwell's Demon: Entropy, Information, Computing'', Princeton University Press, Princeton, New Jersey (1990). {{isbn|0-691-08727-X}}
* [[Robert K. Logan]]. ''What is Information? - Propagating Organization in the Biosphere, the Symbolosphere, the Technosphere and the Econosphere'', Toronto: DEMO Publishing.
* [[Robert K. Logan]]. ''What is Information? - Propagating Organization in the Biosphere, the Symbolosphere, the Technosphere and the Econosphere'', Toronto: DEMO Publishing.
* Tom Siegfried, ''The Bit and the Pendulum'', Wiley, 2000. {{isbn|0-471-32174-5}}
* Tom Siegfried, ''The Bit and the Pendulum'', Wiley, 2000. {{isbn|0-471-32174-5}}
* Charles Seife, ''[[Decoding the Universe]]'', Viking, 2006. {{isbn|0-670-03441-X}}
* Charles Seife, ''[[Decoding the Universe]]'', Viking, 2006. {{isbn|0-670-03441-X}}
* Jeremy Campbell, ''[[Grammatical Man]]'', Touchstone/Simon & Schuster, 1982, {{isbn|0-671-44062-4}}
* Jeremy Campbell, ''[[Grammatical Man]]'', Touchstone/Simon & Schuster, 1982, {{isbn|0-671-44062-4}}
* Henri Theil, ''Economics and Information Theory'', Rand McNally & Company - Chicago, 1967.
* Henri Theil, ''Economics and Information Theory'', Rand McNally & Company - Chicago, 1967.
* Escolano, Suau, Bonev, ''[https://www.springer.com/computer/image+processing/book/978-1-84882-296-2 Information Theory in Computer Vision and Pattern Recognition]'', Springer, 2009. {{isbn|978-1-84882-296-2}}
* Escolano, Suau, Bonev, ''[https://www.springer.com/computer/image+processing/book/978-1-84882-296-2 Information Theory in Computer Vision and Pattern Recognition]'', Springer, 2009. {{isbn|978-1-84882-296-2}}
* Vlatko Vedral, ''Decoding Reality: The Universe as Quantum Information'', Oxford University Press 2010. {{ISBN|0-19-923769-7}}
* Vlatko Vedral, ''Decoding Reality: The Universe as Quantum Information'', Oxford University Press 2010. {{ISBN|0-19-923769-7}}
{{refend}}
{{refend}}
===信息论大型开放式课程===
===MOOC on information theory===
* Raymond W. Yeung, "[http://www.inc.cuhk.edu.hk/InformationTheory/index.html Information Theory]" ([[The Chinese University of Hong Kong]])
* Raymond W. Yeung, "[http://www.inc.cuhk.edu.hk/InformationTheory/index.html Information Theory]" ([[The Chinese University of Hong Kong]])
==外部链接==
==External links==
{{Wikiquote}}
{{Wikiquote}}
{{Library resources box}}
{{Library resources box}}
* {{SpringerEOM |title=Information |id=p/i051040}}
* {{SpringerEOM |title=Information |id=p/i051040}}
* Lambert F. L. (1999), "[http://jchemed.chem.wisc.edu/Journal/Issues/1999/Oct/abs1385.html Shuffled Cards, Messy Desks, and Disorderly Dorm Rooms - Examples of Entropy Increase? Nonsense!]", ''Journal of Chemical Education''
* Lambert F. L. (1999), "[http://jchemed.chem.wisc.edu/Journal/Issues/1999/Oct/abs1385.html Shuffled Cards, Messy Desks, and Disorderly Dorm Rooms - Examples of Entropy Increase? Nonsense!]", ''Journal of Chemical Education''
* [http://www.itsoc.org/ IEEE Information Theory Society] and [https://www.itsoc.org/resources/surveys ITSOC Monographs, Surveys, and Reviews]
* [http://www.itsoc.org/ IEEE Information Theory Society] and [https://www.itsoc.org/resources/surveys ITSOC Monographs, Surveys, and Reviews]
{{Cybernetics}}
{{Cybernetics}}
{{Compression methods}}
{{Compression methods}}
{{Areas of mathematics}}
{{Areas of mathematics}}
{{Computer science}}
{{Computer science}}
{{Authority control}}
{{Authority control}}
{{DEFAULTSORT:Information Theory}}
{{DEFAULTSORT:Information Theory}}
[[Category:Information theory| ]]
[[Category:Information theory| ]]
[[Category:Computer science]]
[[Category:Computer science]]