<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="zh-Hans-CN">
	<id>https://wiki.swarma.org/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Zengsihang</id>
	<title>集智百科 - 复杂系统|人工智能|复杂科学|复杂网络|自组织 - 用户贡献 [zh-cn]</title>
	<link rel="self" type="application/atom+xml" href="https://wiki.swarma.org/api.php?action=feedcontributions&amp;feedformat=atom&amp;user=Zengsihang"/>
	<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php/%E7%89%B9%E6%AE%8A:%E7%94%A8%E6%88%B7%E8%B4%A1%E7%8C%AE/Zengsihang"/>
	<updated>2026-11-03T04:30:13Z</updated>
	<subtitle>用户贡献</subtitle>
	<generator>MediaWiki 1.35.0</generator>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14122</id>
		<title>集群机器人</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14122"/>
		<updated>2020-09-20T12:05:39Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条已由Jie初步翻译 已由Zengsihang初步审校&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{多个问题 |&lt;br /&gt;
&lt;br /&gt;
{{essay-like|date=May 2016}}&lt;br /&gt;
&lt;br /&gt;
{{more footnotes|date=August 2013}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
[[File:RechargingSwarm.jpg|thumb|right|Swarm of [[open-source]] Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
Swarm of [[open-source Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
一群开源茉莉微型机器人正在自行充电&lt;br /&gt;
&lt;br /&gt;
[[Image:IRobot Create team.jpg|thumb|right|A team of [[iRobot Create]] [[robot]]s at the [[Georgia Institute of Technology]]]]&lt;br /&gt;
&lt;br /&gt;
A team of [[iRobot Create robots at the Georgia Institute of Technology]]&lt;br /&gt;
&lt;br /&gt;
佐治亚理工学院的iRobot Create机器人团队&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Swarm robotics''' is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical [[robot]]s. It is supposed that a desired [[collective behavior]] emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of [[artificial swarm intelligence]], as well as the biological studies of insects, ants and other fields in nature, where [[swarm behaviour]] occurs.&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical robots. It is supposed that a desired collective behavior emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of artificial swarm intelligence, as well as the biological studies of insects, ants and other fields in nature, where swarm behaviour occurs.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 集群机器人技术 Swarm Robotics&amp;lt;/font&amp;gt;'''是通过某一种方法将多个机器人协调为一个系统，该系统由大量多数简单的物理机器人组成。该方法假定，在机器人之间以及机器人与环境之间的相互作用中，会产生一种预期的集体行为。该方法经常出现在人工群体智能领域，同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该系统由大量多数简单的物理机器人组成”改为“该系统由大量的、多数为简单的物理机器人组成”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括”中的“有所囊括”改为“有所帮助”&lt;br /&gt;
&lt;br /&gt;
== Definition 定义 ==&lt;br /&gt;
&lt;br /&gt;
The research of swarm [[robotics]] is to study the design of robots, their physical body and their controlling [[behaviour]]s. It is inspired but not limited by&amp;lt;ref&amp;gt;{{Cite web|url=https://theconversation.com/the-social-animals-that-are-inspiring-new-behaviours-for-robot-swarms-113584|title=The social animals that are inspiring new behaviours for robot swarms|last=Hunt|first=Edmund R.|date=2019-03-27|website=The Conversation|language=en-UK|access-date=2019-03-28}}&amp;lt;/ref&amp;gt; the [[emergent behaviour]] observed in [[social insect]]s, called [[swarm intelligence]]. Relatively simple individual rules can produce a large set of complex [[swarm behaviour]]s. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
The research of swarm robotics is to study the design of robots, their physical body and their controlling behaviours. It is inspired but not limited by the emergent behaviour observed in social insects, called swarm intelligence. Relatively simple individual rules can produce a large set of complex swarm behaviours. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的研究包括：机器人的设计，物理构造及其行为控制。它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能。相对简单的个体规则会产生大量复杂的群体行为。其关键组成部分是建立起持续反馈系统，该反馈系统主要来自于小组成员之间的无间断沟通。群体行为涉及到个体在合作中不断产生的变化，同时也包括整个群体展现出的行为表现。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能”改为“它受到社会性昆虫中观察到的新兴行为（被称为集群智能）的启发，并有所延伸”&lt;br /&gt;
&lt;br /&gt;
Unlike [[distributed robotic system]]s in general, swarm robotics emphasizes a ''large'' number of robots, and promotes [[scalability]], for instance by using only local communication.&amp;lt;ref&amp;gt;{{cite book|last=Hamann|first=H.|title=Swarm Robotics: A Formal Approach|url=https://books.google.com/books?id=pnNLDwAAQBAJ|year=2018|publisher=Springer International Publishing|location=New York|isbn=978-3-319-74528-2}}&amp;lt;/ref&amp;gt; That local communication for example can be achieved by [[wireless]] transmission systems, like [[radio frequency]] or [[infrared]].&amp;lt;ref&amp;gt;[http://correll.cs.colorado.edu/wp-content/uploads/correll_rus_chapter3.pdf N. Correll, D. Rus. Architectures and control of networked robotic systems. In: Serge Kernbach (Ed.): Handbook of Collective Robotics, pp. 81-104, Pan Stanford, Singapore, 2013.]&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Unlike distributed robotic systems in general, swarm robotics emphasizes a large number of robots, and promotes scalability, for instance by using only local communication. That local communication for example can be achieved by wireless transmission systems, like radio frequency or infrared.&lt;br /&gt;
&lt;br /&gt;
与一般的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 分布式机器人系统Distributed Robotic Systems&amp;lt;/font&amp;gt;'''不同，群体机器人技术强调需要大量的机器人并提高其可扩展性，例如仅使用本地通信连接。该本地通信包括可以通过无线传输系统实现，例如射频或红外。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该本地通信包括可以通过无线传输系统实现”改为“本地通信可以通过无线传输系统实现”&lt;br /&gt;
&lt;br /&gt;
== Goals and applications 目标与应用 ==&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow [[scalability]], making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow scalability, making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
微型化和成本是集群机器人技术的两大关键因素。它们会制约着大型机器人群体的构建；因此，单个团队成员的简单性就显得尤为重要。其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为。目前出现了大量关于单个机器人级别简单性目标的研究。如果能够在集群机器人技术研究中使用实际硬件操作而非通过仿真实现，就可以使研究人员遇到并解决更多问题，从而加深集群行为的研究。因此，开发用于集群智能研究的简单机器人是该领域发展中非常重要的环节。目标包括：降低单个机器人的成本，和提升它的可扩展性，从而使集群中的每个机器人对资源消耗更少，因此会提高其功率或能效。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为”改为“这些机器人应当从群体层面激发出群体智能方法，以产生有意义的行为，而非在个体层面各自运行”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“目前出现了大量关于单个机器人级别简单性目标的研究”改为“当下有很多针对于机器人简单性的个体层面的研究”&lt;br /&gt;
&lt;br /&gt;
Compared with individual robots, a swarm can commonly decompose its given missions to their subtasks; A swarm is more robust to partial swarm failure and is more flexible with regard to different missions&lt;br /&gt;
&lt;br /&gt;
与单个机器人相比，集群机器人通常可以将其给定的任务自行分解为子任务；对于部分集群指令失效的情况，集群机器人更加稳定，它们在执行不同任务时更为灵活。&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System&amp;lt;ref&amp;gt;{{citation|doi=10.1109/CYBER.2012.6392577|chapter=Libot: Design of a low cost mobile robot for outdoor swarm robotics|title=2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER)|pages=342–347|year=2012|last1=Zahugi|first1=Emaad Mohamed H.|last2=Shabani|first2=Ahmed M.|last3=Prasad|first3=T. V.|isbn=978-1-4673-1421-3}}&amp;lt;/ref&amp;gt; that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias),&amp;lt;ref&amp;gt;Arvin, F.; Murray, J.C.; Licheng Shi; Chun Zhang; Shigang Yue, &amp;quot;[https://www.researchgate.net/profile/Farshad_Arvin/publication/271545281_Development_of_an_autonomous_micro_robot_for_swarm_robotics/links/55e4bad008aede0b57357ed4.pdf Development of an autonomous micro robot for swarm robotics],&amp;quot; Mechatronics and Automation (ICMA), 2014 IEEE International Conference on , vol., no., pp.635,640, 3-6 Aug. 2014 doi: 10.1109/ICMA.2014.6885771&amp;lt;/ref&amp;gt; built in the Computer Intelligence Lab at the [[University of Lincoln]], UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias), built in the Computer Intelligence Lab at the University of Lincoln, UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
有一种叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; LIBOT机器人系统LIBOT Robotic System&amp;lt;/font&amp;gt;'''的集群系统，本质上是由一个低成本的机器人组成的户外的机器人群体。由于GPS传感器在建筑物内部通讯不畅，这些机器人同时配备了Wi-Fi设备。另外一个进行此类尝试的是个叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; Colias&amp;lt;/font&amp;gt;'''的微型机器人，该机器人在英国林肯大学的计算机智能实验室中建立。这款微型机器人建立在4厘米的圆形底盘上，其低成本和开放的平台使它兼容于各种集群机器人的应用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Applications 应用 ===&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand [[miniaturization]] ([[nanorobotics]], [[microbotics]]), like distributed sensing tasks in [[micromachinery]] or the [[human body]]. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance [[mining]] or agricultural [[foraging]] tasks.&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand miniaturization (nanorobotics, microbotics), like distributed sensing tasks in micromachinery or the human body. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance mining or agricultural foraging tasks.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的潜在应用很多。它们包括具有微型化需求的任务（纳米机器人，微生物学），比如微型机械或人体中的分布式传感任务。集群机器人技术最有前途的应用之一是在灾难救援任务中，大量不同尺寸的机器人可以被送到救援人员无法安全到达的地方，通过红外传感器探测生命的存在。另一方面，集群机器人技术也适合需要低廉经济的设计任务，例如采矿或农业采掘任务。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“纳米机器人，微生物学”改为“纳米级机器人，微米级机器人”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of [[military robot]]s can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&amp;lt;ref&amp;gt;{{cite web|url=http://www.cnn.com/2014/10/06/tech/innovation/navy-swarm-boats/index.html|title=U.S. Navy could 'swarm' foes with robot boats|first=Brad |last=Lendon|publisher=CNN}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of military robots can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&lt;br /&gt;
&lt;br /&gt;
除此之外，有争议的是军事集群机器人，它可以组成一支自主部队。美国海军已经对一大批可以自行操纵并采取进攻行为的自主舰艇进行了测试。这些船是无人驾驶的，可以安装任何种类的工具来威慑和摧毁敌方船只。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
During the [[Syrian Civil War]], Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&amp;lt;ref&amp;gt;{{Cite web|url=https://www.theatlantic.com/technology/archive/2018/03/drone-swarms-are-going-to-be-terrifying/555005/|title=Drone Swarms Are Going to Be Terrifying and Hard to Stop|last=Madrigal|first=Alexis C.|date=2018-03-07|website=The Atlantic|language=en-US|access-date=2019-03-07}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
During the Syrian Civil War, Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&lt;br /&gt;
&lt;br /&gt;
在叙利亚内战期间，该地区的俄罗斯部队报告指出，该国主要空军基地遭到装有炸药的固定翼无人机群袭击。&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&amp;lt;ref&amp;gt;{{cite web |title=A self-organizing thousand-robot swarm |url=http://www.seas.harvard.edu/news/2014/08/self-organizing-thousand-robot-swarm |work=Harvard |date=14 August 2014 |accessdate=16 August 2014 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&lt;br /&gt;
&lt;br /&gt;
目前大多数研究成果都集中在相对小规模的集群机体上。然而，哈佛大学在2014年展示了由1,024个机器人组成的群体，这是迄今为止规模最大的机器人群体。&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of [[micro air vehicle]]s, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise [[motion capture]] systems in laboratory conditions,&amp;lt;ref&amp;gt;Kushleyev, A.; Mellinger, D.; Powers, C.; Kumar, V., &amp;quot;[https://pdfs.semanticscholar.org/b063/239bd450038531eeb2db5466eaed34a0f9a0.pdf Towards a swarm of agile micro quadrotors]&amp;quot; Autonomous Robots, Volume 35, Issue 4, pp 287-300, November 2013&amp;lt;/ref&amp;gt; current systems such as [[Shooting Star (drone)|Shooting Star]] can control teams of hundreds of micro aerial vehicles in outdoor environment&amp;lt;ref&amp;gt;Vasarhelyi, G.; Virágh, C.; Tarcai, N.; Somorjai, G.; Vicsek, T. [https://arxiv.org/pdf/1402.3588 Outdoor flocking and formation flight with autonomous aerial robots]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), 2014&amp;lt;/ref&amp;gt; using [[Satellite navigation|GNSS]] systems (such as GPS) or even  stabilize them using onboard [[robot localization|localization]] systems&amp;lt;ref&amp;gt;Faigl, J.; Krajnik, T.; Chudoba, J.; Preucil, L.; Saska, M. [http://eprints.lincoln.ac.uk/13799/1/__ddat02_staffhome_jpartridge_camera_2013_ICRA.pdf Low-Cost Embedded System for Relative Localization in Robotic Swarms]. In ICRA2013: Proceedings of 2013 IEEE International Conference on Robotics and Automation. 2013.&amp;lt;/ref&amp;gt; where GPS is unavailable.&amp;lt;ref&amp;gt;Saska, M.; Vakula, J.; Preucil, L. [https://ieeexplore.ieee.org/abstract/document/6907374/ Swarms of Micro Aerial Vehicles Stabilized Under a Visual Relative Localization]. In ICRA2014: Proceedings of 2014 IEEE International Conference on Robotics and Automation. 2014.&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Saska, M. [https://www.researchgate.net/profile/Martin_Saska/publication/282922149_MAV-swarms_Unmanned_aerial_vehicles_stabilized_along_a_given_path_using_onboard_relative_localization/links/5684f75b08ae19758394dcdf.pdf MAV-swarms: unmanned aerial vehicles stabilized along a given path using onboard relative localization]. In Proceedings of 2015 International Conference on Unmanned Aircraft Systems (ICUAS). 2015&amp;lt;/ref&amp;gt;  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance,&amp;lt;ref&amp;gt;Saska, M.; Chudoba, J.; Preucil, L.; Thomas, J.; Loianno, G.; Tresnak, A.; Vonasek, V.; Kumar, V. [https://ieeexplore.ieee.org/abstract/document/6842301/ Autonomous Deployment of Swarms of Micro-Aerial Vehicles in Cooperative Surveillance]. In Proceedings of 2014 International Conference on Unmanned Aircraft Systems (ICUAS). 2014.&amp;lt;/ref&amp;gt; plume tracking,&amp;lt;ref&amp;gt;Saska, M.; Langr J.; L. Preucil. [https://www.researchgate.net/profile/Martin_Saska/publication/290558108_Plume_Tracking_by_a_Self-stabilized_Group_of_Micro_Aerial_Vehicles/links/57040e7908ae74a08e245eeb.pdf Plume Tracking by a Self-stabilized Group of Micro Aerial Vehicles]. In Modelling and Simulation for Autonomous Systems, 2014.&amp;lt;/ref&amp;gt; and reconnaissance in a compact phalanx.&amp;lt;ref&amp;gt;Saska, M.; Kasl, Z.; Preucil, L. [http://www.nt.ntnu.no/users/skoge/prost/proceedings/ifac2014/media/files/2295.pdf Motion Planning and Control of Formations of Micro Aerial Vehicles]. In Proceedings of the 19th World Congress of the International Federation of Automatic Control. 2014.&amp;lt;/ref&amp;gt;  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://labe.felk.cvut.cz/~tkrajnik/ardrone/articles/formace.pdf Coordination and Navigation of Heterogeneous UAVs-UGVs Teams Localized by a Hawk-Eye Approach]. In Proceedings of 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2012.&amp;lt;/ref&amp;gt; [[simultaneous localization and mapping]],&amp;lt;ref&amp;gt;Chung, Soon-Jo, et al. &amp;quot;[https://authors.library.caltech.edu/87925/1/tro-aerial-robotics_final.pdf A survey on aerial swarm robotics].&amp;quot; IEEE Transactions on Robotics 34.4 (2018): 837-855.&amp;lt;/ref&amp;gt; convoy protection,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://eprints.lincoln.ac.uk/14891/1/formations_2014_IJRR.pdf Coordination and Navigation of Heterogeneous MAV–UGV Formations Localized by a ‘hawk-eye’-like Approach Under a Model Predictive Control Scheme]. International Journal of Robotics Research 33(10):1393–1412, September 2014.&amp;lt;/ref&amp;gt; and moving target localization and tracking.&amp;lt;ref&amp;gt;Kwon, H; Pack, D. J. [https://link.springer.com/article/10.1007/s10846-011-9581-5 A Robust Mobile Target Localization Method for Cooperative Unmanned Aerial Vehicles Using Sensor Fusion Quality]. Journal of Intelligent and Robotic Systems, Volume 65, Issue 1, pp 479-493, January 2012.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of micro air vehicles, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise motion capture systems in laboratory conditions, current systems such as Shooting Star can control teams of hundreds of micro aerial vehicles in outdoor environment using GNSS systems (such as GPS) or even  stabilize them using onboard localization systems where GPS is unavailable.  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance, plume tracking, and reconnaissance in a compact phalanx.  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring, simultaneous localization and mapping, convoy protection, and moving target localization and tracking.&lt;br /&gt;
&lt;br /&gt;
通过集群飞行器还可以解决另一大类应用，该主题目前也得到了非常广泛的研究。在实验室条件下，相比较于过去使用的精密运动捕捉系统对飞行机器集群进行开创性研究，当前的系统（例如射星系统）则可以使用'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; GNSS全球导航卫星系统&amp;lt;/font&amp;gt;'''（Galeru Nagari Sujala Sravanthi Project, 如GPS全球定位系统）在室外环境条件下，控制数百台微型飞机集群，甚至可以使用GPS无法做到的机载定位系统来稳定它们。成群的微型飞行器已经可以在密集方阵中进行自主监视、羽毛跟踪以及侦察任务中进行测试。在协同无人驾驶地面和空中飞行器集群的大量工作中，已经涉及的应用包括：协同环境监测、即时定位与制图、车队保护、运动目标定位以及跟踪。&lt;br /&gt;
&lt;br /&gt;
== Drone displays 无人机显示器 ==&lt;br /&gt;
&lt;br /&gt;
{{main|Drone display}}&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
无人机显示器通常在夜间使用，通过多个点亮的无人机组合图像来进行艺术展示或广告宣传。&lt;br /&gt;
&lt;br /&gt;
== In popular culture 大众文化 ==&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's [[Big Hero 6 (film)|Big Hero 6]] involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's Big Hero 6 involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
迪士尼《超能陆战队》中有一个情节涉及使用成群的微型机器人来构建场景。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, [[Enthiran]], and its sequel [[2.0 (film)|2.0]].&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, Enthiran, and its sequel 2.0.&lt;br /&gt;
&lt;br /&gt;
在泰米尔语电影《宝莱坞机器人》及其续集2.0中使用了集群机器人技术。&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）只需要标注专业性较强的名词即可 超能陆战队和宝莱坞机器人这种类型的不需要标记  学术性的名词再进行标记 - 已修改&lt;br /&gt;
&lt;br /&gt;
== See also 其他参考资料 ==&lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent 自治主体（代理）]]&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics 基于行为的机器人学]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior) 群集行为(鸟类)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot （建议保持英文名字）]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies 新兴技术清单]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics 微型机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system 多主体系统]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics 纳米机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction 小说中的纳米技术]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics 拟态物理学]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials 机器人材料]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone) 射星（无人机）]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence 集群智慧]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms 集群机器人平台]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter 无人机/四轴飞行器]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{ columns-list | colwidth 22em | &lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent]]s&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone)]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter]]&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）这里的这些名词记得在新的自审清单中的词库进行查证和补充 - 已补充&lt;br /&gt;
&lt;br /&gt;
== References 参考文献==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|20em}}&lt;br /&gt;
&lt;br /&gt;
== External links 相关链接 ==&lt;br /&gt;
&lt;br /&gt;
* [https://www.youtube.com/watch?v=JzbWV1sfZ-A Fully decentralized robotic swarm performing collective search and exploration – Applied Complexity Group and Motion, Energy Control Lab at SUTD  ]&lt;br /&gt;
用于进行群体搜索和探测的全分布式机器人集群–应用复杂性群体和运动 - 新加坡科技设计大学能源控制实验室&lt;br /&gt;
&lt;br /&gt;
* [http://www.swarm-bots.org/ Swarm-bots: Swarms of self-assembling artifacts – EU IST-FET project (2001–2005)]&lt;br /&gt;
集群机器人：自组装构件的集群 – 欧盟IST-FET项目（2001–2005）&lt;br /&gt;
&lt;br /&gt;
* [http://www.aaaivideos.org/2007/morphogenesis/ Award-winning swarm-bot video at AAAI 2007]&lt;br /&gt;
在AAAI 2007上获奖的swarm-bot视频&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{collective animal behaviour}}&lt;br /&gt;
&lt;br /&gt;
{{Robotics}}&lt;br /&gt;
&lt;br /&gt;
{{emerging technologies|topics=yes|robotics=yes|manufacture=yes|materials=yes}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Category:Multi-robot systems]]&lt;br /&gt;
&lt;br /&gt;
Category:Multi-robot systems&lt;br /&gt;
&lt;br /&gt;
类别: 多机器人系统&lt;br /&gt;
&lt;br /&gt;
[[Category:Emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
Category:Emerging technologies&lt;br /&gt;
&lt;br /&gt;
类别: 新兴技术&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Swarm robotics]]. Its edit history can be viewed at [[集群机器人/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14121</id>
		<title>集群机器人</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14121"/>
		<updated>2020-09-20T12:00:23Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条已由Jie初步翻译 已有Zengsihang初步审校&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{多个问题 |&lt;br /&gt;
&lt;br /&gt;
{{essay-like|date=May 2016}}&lt;br /&gt;
&lt;br /&gt;
{{more footnotes|date=August 2013}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
[[File:RechargingSwarm.jpg|thumb|right|Swarm of [[open-source]] Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
Swarm of [[open-source Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
一群开源茉莉微型机器人正在自行充电&lt;br /&gt;
&lt;br /&gt;
[[Image:IRobot Create team.jpg|thumb|right|A team of [[iRobot Create]] [[robot]]s at the [[Georgia Institute of Technology]]]]&lt;br /&gt;
&lt;br /&gt;
A team of [[iRobot Create robots at the Georgia Institute of Technology]]&lt;br /&gt;
&lt;br /&gt;
佐治亚理工学院的iRobot Create机器人团队&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Swarm robotics''' is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical [[robot]]s. It is supposed that a desired [[collective behavior]] emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of [[artificial swarm intelligence]], as well as the biological studies of insects, ants and other fields in nature, where [[swarm behaviour]] occurs.&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical robots. It is supposed that a desired collective behavior emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of artificial swarm intelligence, as well as the biological studies of insects, ants and other fields in nature, where swarm behaviour occurs.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 集群机器人技术 Swarm Robotics&amp;lt;/font&amp;gt;'''是通过某一种方法将多个机器人协调为一个系统，该系统由大量多数简单的物理机器人组成。该方法假定，在机器人之间以及机器人与环境之间的相互作用中，会产生一种预期的集体行为。该方法经常出现在人工群体智能领域，同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该系统由大量多数简单的物理机器人组成”改为“该系统由大量的、多数为简单的物理机器人组成”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括”中的“有所囊括”改为“有所帮助”&lt;br /&gt;
&lt;br /&gt;
== Definition 定义 ==&lt;br /&gt;
&lt;br /&gt;
The research of swarm [[robotics]] is to study the design of robots, their physical body and their controlling [[behaviour]]s. It is inspired but not limited by&amp;lt;ref&amp;gt;{{Cite web|url=https://theconversation.com/the-social-animals-that-are-inspiring-new-behaviours-for-robot-swarms-113584|title=The social animals that are inspiring new behaviours for robot swarms|last=Hunt|first=Edmund R.|date=2019-03-27|website=The Conversation|language=en-UK|access-date=2019-03-28}}&amp;lt;/ref&amp;gt; the [[emergent behaviour]] observed in [[social insect]]s, called [[swarm intelligence]]. Relatively simple individual rules can produce a large set of complex [[swarm behaviour]]s. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
The research of swarm robotics is to study the design of robots, their physical body and their controlling behaviours. It is inspired but not limited by the emergent behaviour observed in social insects, called swarm intelligence. Relatively simple individual rules can produce a large set of complex swarm behaviours. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的研究包括：机器人的设计，物理构造及其行为控制。它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能。相对简单的个体规则会产生大量复杂的群体行为。其关键组成部分是建立起持续反馈系统，该反馈系统主要来自于小组成员之间的无间断沟通。群体行为涉及到个体在合作中不断产生的变化，同时也包括整个群体展现出的行为表现。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能”改为“它受到社会性昆虫中观察到的新兴行为（被称为集群智能）的启发，并有所延伸”&lt;br /&gt;
&lt;br /&gt;
Unlike [[distributed robotic system]]s in general, swarm robotics emphasizes a ''large'' number of robots, and promotes [[scalability]], for instance by using only local communication.&amp;lt;ref&amp;gt;{{cite book|last=Hamann|first=H.|title=Swarm Robotics: A Formal Approach|url=https://books.google.com/books?id=pnNLDwAAQBAJ|year=2018|publisher=Springer International Publishing|location=New York|isbn=978-3-319-74528-2}}&amp;lt;/ref&amp;gt; That local communication for example can be achieved by [[wireless]] transmission systems, like [[radio frequency]] or [[infrared]].&amp;lt;ref&amp;gt;[http://correll.cs.colorado.edu/wp-content/uploads/correll_rus_chapter3.pdf N. Correll, D. Rus. Architectures and control of networked robotic systems. In: Serge Kernbach (Ed.): Handbook of Collective Robotics, pp. 81-104, Pan Stanford, Singapore, 2013.]&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Unlike distributed robotic systems in general, swarm robotics emphasizes a large number of robots, and promotes scalability, for instance by using only local communication. That local communication for example can be achieved by wireless transmission systems, like radio frequency or infrared.&lt;br /&gt;
&lt;br /&gt;
与一般的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 分布式机器人系统Distributed Robotic Systems&amp;lt;/font&amp;gt;'''不同，群体机器人技术强调需要大量的机器人并提高其可扩展性，例如仅使用本地通信连接。该本地通信包括可以通过无线传输系统实现，例如射频或红外。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该本地通信包括可以通过无线传输系统实现”改为“本地通信可以通过无线传输系统实现”&lt;br /&gt;
&lt;br /&gt;
== Goals and applications 目标与应用 ==&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow [[scalability]], making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow scalability, making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
微型化和成本是集群机器人技术的两大关键因素。它们会制约着大型机器人群体的构建；因此，单个团队成员的简单性就显得尤为重要。其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为。目前出现了大量关于单个机器人级别简单性目标的研究。如果能够在集群机器人技术研究中使用实际硬件操作而非通过仿真实现，就可以使研究人员遇到并解决更多问题，从而加深集群行为的研究。因此，开发用于集群智能研究的简单机器人是该领域发展中非常重要的环节。目标包括：降低单个机器人的成本，和提升它的可扩展性，从而使集群中的每个机器人对资源消耗更少，因此会提高其功率或能效。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为”改为“这些机器人应当从群体层面激发出群体智能方法，以产生有意义的行为，而非在个体层面各自运行”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“目前出现了大量关于单个机器人级别简单性目标的研究”改为“当下有很多针对于机器人简单性的个体层面的研究”&lt;br /&gt;
&lt;br /&gt;
Compared with individual robots, a swarm can commonly decompose its given missions to their subtasks; A swarm is more robust to partial swarm failure and is more flexible with regard to different missions&lt;br /&gt;
&lt;br /&gt;
与单个机器人相比，集群机器人通常可以将其给定的任务自行分解为子任务；对于部分集群指令失效的情况，集群机器人更加稳定，它们在执行不同任务时更为灵活。&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System&amp;lt;ref&amp;gt;{{citation|doi=10.1109/CYBER.2012.6392577|chapter=Libot: Design of a low cost mobile robot for outdoor swarm robotics|title=2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER)|pages=342–347|year=2012|last1=Zahugi|first1=Emaad Mohamed H.|last2=Shabani|first2=Ahmed M.|last3=Prasad|first3=T. V.|isbn=978-1-4673-1421-3}}&amp;lt;/ref&amp;gt; that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias),&amp;lt;ref&amp;gt;Arvin, F.; Murray, J.C.; Licheng Shi; Chun Zhang; Shigang Yue, &amp;quot;[https://www.researchgate.net/profile/Farshad_Arvin/publication/271545281_Development_of_an_autonomous_micro_robot_for_swarm_robotics/links/55e4bad008aede0b57357ed4.pdf Development of an autonomous micro robot for swarm robotics],&amp;quot; Mechatronics and Automation (ICMA), 2014 IEEE International Conference on , vol., no., pp.635,640, 3-6 Aug. 2014 doi: 10.1109/ICMA.2014.6885771&amp;lt;/ref&amp;gt; built in the Computer Intelligence Lab at the [[University of Lincoln]], UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias), built in the Computer Intelligence Lab at the University of Lincoln, UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
有一种叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; LIBOT机器人系统LIBOT Robotic System&amp;lt;/font&amp;gt;'''的集群系统，本质上是由一个低成本的机器人组成的户外的机器人群体。由于GPS传感器在建筑物内部通讯不畅，这些机器人同时配备了Wi-Fi设备。另外一个进行此类尝试的是个叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; Colias&amp;lt;/font&amp;gt;'''的微型机器人，该机器人在英国林肯大学的计算机智能实验室中建立。这款微型机器人建立在4厘米的圆形底盘上，其低成本和开放的平台使它兼容于各种集群机器人的应用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Applications 应用 ===&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand [[miniaturization]] ([[nanorobotics]], [[microbotics]]), like distributed sensing tasks in [[micromachinery]] or the [[human body]]. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance [[mining]] or agricultural [[foraging]] tasks.&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand miniaturization (nanorobotics, microbotics), like distributed sensing tasks in micromachinery or the human body. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance mining or agricultural foraging tasks.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的潜在应用很多。它们包括具有微型化需求的任务（纳米机器人，微生物学），比如微型机械或人体中的分布式传感任务。集群机器人技术最有前途的应用之一是在灾难救援任务中，大量不同尺寸的机器人可以被送到救援人员无法安全到达的地方，通过红外传感器探测生命的存在。另一方面，集群机器人技术也适合需要低廉经济的设计任务，例如采矿或农业采掘任务。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“纳米机器人，微生物学”改为“纳米级机器人，微米级机器人”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of [[military robot]]s can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&amp;lt;ref&amp;gt;{{cite web|url=http://www.cnn.com/2014/10/06/tech/innovation/navy-swarm-boats/index.html|title=U.S. Navy could 'swarm' foes with robot boats|first=Brad |last=Lendon|publisher=CNN}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of military robots can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&lt;br /&gt;
&lt;br /&gt;
除此之外，有争议的是军事集群机器人，它可以组成一支自主部队。美国海军已经对一大批可以自行操纵并采取进攻行为的自主舰艇进行了测试。这些船是无人驾驶的，可以安装任何种类的工具来威慑和摧毁敌方船只。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
During the [[Syrian Civil War]], Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&amp;lt;ref&amp;gt;{{Cite web|url=https://www.theatlantic.com/technology/archive/2018/03/drone-swarms-are-going-to-be-terrifying/555005/|title=Drone Swarms Are Going to Be Terrifying and Hard to Stop|last=Madrigal|first=Alexis C.|date=2018-03-07|website=The Atlantic|language=en-US|access-date=2019-03-07}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
During the Syrian Civil War, Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&lt;br /&gt;
&lt;br /&gt;
在叙利亚内战期间，该地区的俄罗斯部队报告指出，该国主要空军基地遭到装有炸药的固定翼无人机群袭击。&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&amp;lt;ref&amp;gt;{{cite web |title=A self-organizing thousand-robot swarm |url=http://www.seas.harvard.edu/news/2014/08/self-organizing-thousand-robot-swarm |work=Harvard |date=14 August 2014 |accessdate=16 August 2014 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&lt;br /&gt;
&lt;br /&gt;
目前大多数研究成果都集中在相对小规模的集群机体上。然而，哈佛大学在2014年展示了由1,024个机器人组成的群体，这是迄今为止规模最大的机器人群体。&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of [[micro air vehicle]]s, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise [[motion capture]] systems in laboratory conditions,&amp;lt;ref&amp;gt;Kushleyev, A.; Mellinger, D.; Powers, C.; Kumar, V., &amp;quot;[https://pdfs.semanticscholar.org/b063/239bd450038531eeb2db5466eaed34a0f9a0.pdf Towards a swarm of agile micro quadrotors]&amp;quot; Autonomous Robots, Volume 35, Issue 4, pp 287-300, November 2013&amp;lt;/ref&amp;gt; current systems such as [[Shooting Star (drone)|Shooting Star]] can control teams of hundreds of micro aerial vehicles in outdoor environment&amp;lt;ref&amp;gt;Vasarhelyi, G.; Virágh, C.; Tarcai, N.; Somorjai, G.; Vicsek, T. [https://arxiv.org/pdf/1402.3588 Outdoor flocking and formation flight with autonomous aerial robots]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), 2014&amp;lt;/ref&amp;gt; using [[Satellite navigation|GNSS]] systems (such as GPS) or even  stabilize them using onboard [[robot localization|localization]] systems&amp;lt;ref&amp;gt;Faigl, J.; Krajnik, T.; Chudoba, J.; Preucil, L.; Saska, M. [http://eprints.lincoln.ac.uk/13799/1/__ddat02_staffhome_jpartridge_camera_2013_ICRA.pdf Low-Cost Embedded System for Relative Localization in Robotic Swarms]. In ICRA2013: Proceedings of 2013 IEEE International Conference on Robotics and Automation. 2013.&amp;lt;/ref&amp;gt; where GPS is unavailable.&amp;lt;ref&amp;gt;Saska, M.; Vakula, J.; Preucil, L. [https://ieeexplore.ieee.org/abstract/document/6907374/ Swarms of Micro Aerial Vehicles Stabilized Under a Visual Relative Localization]. In ICRA2014: Proceedings of 2014 IEEE International Conference on Robotics and Automation. 2014.&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Saska, M. [https://www.researchgate.net/profile/Martin_Saska/publication/282922149_MAV-swarms_Unmanned_aerial_vehicles_stabilized_along_a_given_path_using_onboard_relative_localization/links/5684f75b08ae19758394dcdf.pdf MAV-swarms: unmanned aerial vehicles stabilized along a given path using onboard relative localization]. In Proceedings of 2015 International Conference on Unmanned Aircraft Systems (ICUAS). 2015&amp;lt;/ref&amp;gt;  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance,&amp;lt;ref&amp;gt;Saska, M.; Chudoba, J.; Preucil, L.; Thomas, J.; Loianno, G.; Tresnak, A.; Vonasek, V.; Kumar, V. [https://ieeexplore.ieee.org/abstract/document/6842301/ Autonomous Deployment of Swarms of Micro-Aerial Vehicles in Cooperative Surveillance]. In Proceedings of 2014 International Conference on Unmanned Aircraft Systems (ICUAS). 2014.&amp;lt;/ref&amp;gt; plume tracking,&amp;lt;ref&amp;gt;Saska, M.; Langr J.; L. Preucil. [https://www.researchgate.net/profile/Martin_Saska/publication/290558108_Plume_Tracking_by_a_Self-stabilized_Group_of_Micro_Aerial_Vehicles/links/57040e7908ae74a08e245eeb.pdf Plume Tracking by a Self-stabilized Group of Micro Aerial Vehicles]. In Modelling and Simulation for Autonomous Systems, 2014.&amp;lt;/ref&amp;gt; and reconnaissance in a compact phalanx.&amp;lt;ref&amp;gt;Saska, M.; Kasl, Z.; Preucil, L. [http://www.nt.ntnu.no/users/skoge/prost/proceedings/ifac2014/media/files/2295.pdf Motion Planning and Control of Formations of Micro Aerial Vehicles]. In Proceedings of the 19th World Congress of the International Federation of Automatic Control. 2014.&amp;lt;/ref&amp;gt;  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://labe.felk.cvut.cz/~tkrajnik/ardrone/articles/formace.pdf Coordination and Navigation of Heterogeneous UAVs-UGVs Teams Localized by a Hawk-Eye Approach]. In Proceedings of 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2012.&amp;lt;/ref&amp;gt; [[simultaneous localization and mapping]],&amp;lt;ref&amp;gt;Chung, Soon-Jo, et al. &amp;quot;[https://authors.library.caltech.edu/87925/1/tro-aerial-robotics_final.pdf A survey on aerial swarm robotics].&amp;quot; IEEE Transactions on Robotics 34.4 (2018): 837-855.&amp;lt;/ref&amp;gt; convoy protection,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://eprints.lincoln.ac.uk/14891/1/formations_2014_IJRR.pdf Coordination and Navigation of Heterogeneous MAV–UGV Formations Localized by a ‘hawk-eye’-like Approach Under a Model Predictive Control Scheme]. International Journal of Robotics Research 33(10):1393–1412, September 2014.&amp;lt;/ref&amp;gt; and moving target localization and tracking.&amp;lt;ref&amp;gt;Kwon, H; Pack, D. J. [https://link.springer.com/article/10.1007/s10846-011-9581-5 A Robust Mobile Target Localization Method for Cooperative Unmanned Aerial Vehicles Using Sensor Fusion Quality]. Journal of Intelligent and Robotic Systems, Volume 65, Issue 1, pp 479-493, January 2012.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of micro air vehicles, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise motion capture systems in laboratory conditions, current systems such as Shooting Star can control teams of hundreds of micro aerial vehicles in outdoor environment using GNSS systems (such as GPS) or even  stabilize them using onboard localization systems where GPS is unavailable.  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance, plume tracking, and reconnaissance in a compact phalanx.  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring, simultaneous localization and mapping, convoy protection, and moving target localization and tracking.&lt;br /&gt;
&lt;br /&gt;
通过集群飞行器还可以解决另一大类应用，该主题目前也得到了非常广泛的研究。在实验室条件下，相比较于过去使用的精密运动捕捉系统对飞行机器集群进行开创性研究，当前的系统（例如射星系统）则可以使用'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; GNSS全球导航卫星系统&amp;lt;/font&amp;gt;'''（Galeru Nagari Sujala Sravanthi Project, 如GPS全球定位系统）在室外环境条件下，控制数百台微型飞机集群，甚至可以使用GPS无法做到的机载定位系统来稳定它们。成群的微型飞行器已经可以在密集方阵中进行自主监视、羽毛跟踪以及侦察任务中进行测试。在协同无人驾驶地面和空中飞行器集群的大量工作中，已经涉及的应用包括：协同环境监测、即时定位与制图、车队保护、运动目标定位以及跟踪。&lt;br /&gt;
&lt;br /&gt;
== Drone displays 无人机显示器 ==&lt;br /&gt;
&lt;br /&gt;
{{main|Drone display}}&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
无人机显示器通常在夜间使用，通过多个点亮的无人机组合图像来进行艺术展示或广告宣传。&lt;br /&gt;
&lt;br /&gt;
== In popular culture 大众文化 ==&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's [[Big Hero 6 (film)|Big Hero 6]] involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's Big Hero 6 involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
迪士尼《超能陆战队》中有一个情节涉及使用成群的微型机器人来构建场景。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, [[Enthiran]], and its sequel [[2.0 (film)|2.0]].&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, Enthiran, and its sequel 2.0.&lt;br /&gt;
&lt;br /&gt;
在泰米尔语电影《宝莱坞机器人》及其续集2.0中使用了集群机器人技术。&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）只需要标注专业性较强的名词即可 超能陆战队和宝莱坞机器人这种类型的不需要标记  学术性的名词再进行标记 - 已修改&lt;br /&gt;
&lt;br /&gt;
== See also 其他参考资料 ==&lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent 自治主体（代理）]]&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics 基于行为的机器人学]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior) 群集行为(鸟类)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot （建议保持英文名字）]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies 新兴技术清单]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics 微型机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system 多主体系统]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics 纳米机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction 小说中的纳米技术]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics 拟态物理学]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials 机器人材料]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone) 射星（无人机）]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence 集群智慧]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms 集群机器人平台]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter 无人机/四轴飞行器]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{ columns-list | colwidth 22em | &lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent]]s&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone)]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter]]&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）这里的这些名词记得在新的自审清单中的词库进行查证和补充 - 已补充&lt;br /&gt;
&lt;br /&gt;
== References 参考文献==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|20em}}&lt;br /&gt;
&lt;br /&gt;
== External links 相关链接 ==&lt;br /&gt;
&lt;br /&gt;
* [https://www.youtube.com/watch?v=JzbWV1sfZ-A Fully decentralized robotic swarm performing collective search and exploration – Applied Complexity Group and Motion, Energy Control Lab at SUTD  ]&lt;br /&gt;
用于进行群体搜索和探测的全分布式机器人集群–应用复杂性群体和运动 - 新加坡科技设计大学能源控制实验室&lt;br /&gt;
&lt;br /&gt;
* [http://www.swarm-bots.org/ Swarm-bots: Swarms of self-assembling artifacts – EU IST-FET project (2001–2005)]&lt;br /&gt;
集群机器人：自组装构件的集群 – 欧盟IST-FET项目（2001–2005）&lt;br /&gt;
&lt;br /&gt;
* [http://www.aaaivideos.org/2007/morphogenesis/ Award-winning swarm-bot video at AAAI 2007]&lt;br /&gt;
在AAAI 2007上获奖的swarm-bot视频&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{collective animal behaviour}}&lt;br /&gt;
&lt;br /&gt;
{{Robotics}}&lt;br /&gt;
&lt;br /&gt;
{{emerging technologies|topics=yes|robotics=yes|manufacture=yes|materials=yes}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Category:Multi-robot systems]]&lt;br /&gt;
&lt;br /&gt;
Category:Multi-robot systems&lt;br /&gt;
&lt;br /&gt;
类别: 多机器人系统&lt;br /&gt;
&lt;br /&gt;
[[Category:Emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
Category:Emerging technologies&lt;br /&gt;
&lt;br /&gt;
类别: 新兴技术&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Swarm robotics]]. Its edit history can be viewed at [[集群机器人/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14120</id>
		<title>集群机器人</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14120"/>
		<updated>2020-09-20T11:59:38Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条已由Jie初步翻译&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{多个问题 |&lt;br /&gt;
&lt;br /&gt;
{{essay-like|date=May 2016}}&lt;br /&gt;
&lt;br /&gt;
{{more footnotes|date=August 2013}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
[[File:RechargingSwarm.jpg|thumb|right|Swarm of [[open-source]] Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
Swarm of [[open-source Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
一群开源茉莉微型机器人正在自行充电&lt;br /&gt;
&lt;br /&gt;
[[Image:IRobot Create team.jpg|thumb|right|A team of [[iRobot Create]] [[robot]]s at the [[Georgia Institute of Technology]]]]&lt;br /&gt;
&lt;br /&gt;
A team of [[iRobot Create robots at the Georgia Institute of Technology]]&lt;br /&gt;
&lt;br /&gt;
佐治亚理工学院的iRobot Create机器人团队&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Swarm robotics''' is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical [[robot]]s. It is supposed that a desired [[collective behavior]] emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of [[artificial swarm intelligence]], as well as the biological studies of insects, ants and other fields in nature, where [[swarm behaviour]] occurs.&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical robots. It is supposed that a desired collective behavior emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of artificial swarm intelligence, as well as the biological studies of insects, ants and other fields in nature, where swarm behaviour occurs.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 集群机器人技术 Swarm Robotics&amp;lt;/font&amp;gt;'''是通过某一种方法将多个机器人协调为一个系统，该系统由大量多数简单的物理机器人组成。该方法假定，在机器人之间以及机器人与环境之间的相互作用中，会产生一种预期的集体行为。该方法经常出现在人工群体智能领域，同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该系统由大量多数简单的物理机器人组成”改为“该系统由大量的、多数为简单的物理机器人组成”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括”中的“有所囊括”改为“有所帮助”&lt;br /&gt;
&lt;br /&gt;
== Definition 定义 ==&lt;br /&gt;
&lt;br /&gt;
The research of swarm [[robotics]] is to study the design of robots, their physical body and their controlling [[behaviour]]s. It is inspired but not limited by&amp;lt;ref&amp;gt;{{Cite web|url=https://theconversation.com/the-social-animals-that-are-inspiring-new-behaviours-for-robot-swarms-113584|title=The social animals that are inspiring new behaviours for robot swarms|last=Hunt|first=Edmund R.|date=2019-03-27|website=The Conversation|language=en-UK|access-date=2019-03-28}}&amp;lt;/ref&amp;gt; the [[emergent behaviour]] observed in [[social insect]]s, called [[swarm intelligence]]. Relatively simple individual rules can produce a large set of complex [[swarm behaviour]]s. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
The research of swarm robotics is to study the design of robots, their physical body and their controlling behaviours. It is inspired but not limited by the emergent behaviour observed in social insects, called swarm intelligence. Relatively simple individual rules can produce a large set of complex swarm behaviours. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的研究包括：机器人的设计，物理构造及其行为控制。它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能。相对简单的个体规则会产生大量复杂的群体行为。其关键组成部分是建立起持续反馈系统，该反馈系统主要来自于小组成员之间的无间断沟通。群体行为涉及到个体在合作中不断产生的变化，同时也包括整个群体展现出的行为表现。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能”改为“它受到社会性昆虫中观察到的新兴行为（被称为集群智能）的启发，并有所延伸”&lt;br /&gt;
&lt;br /&gt;
Unlike [[distributed robotic system]]s in general, swarm robotics emphasizes a ''large'' number of robots, and promotes [[scalability]], for instance by using only local communication.&amp;lt;ref&amp;gt;{{cite book|last=Hamann|first=H.|title=Swarm Robotics: A Formal Approach|url=https://books.google.com/books?id=pnNLDwAAQBAJ|year=2018|publisher=Springer International Publishing|location=New York|isbn=978-3-319-74528-2}}&amp;lt;/ref&amp;gt; That local communication for example can be achieved by [[wireless]] transmission systems, like [[radio frequency]] or [[infrared]].&amp;lt;ref&amp;gt;[http://correll.cs.colorado.edu/wp-content/uploads/correll_rus_chapter3.pdf N. Correll, D. Rus. Architectures and control of networked robotic systems. In: Serge Kernbach (Ed.): Handbook of Collective Robotics, pp. 81-104, Pan Stanford, Singapore, 2013.]&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Unlike distributed robotic systems in general, swarm robotics emphasizes a large number of robots, and promotes scalability, for instance by using only local communication. That local communication for example can be achieved by wireless transmission systems, like radio frequency or infrared.&lt;br /&gt;
&lt;br /&gt;
与一般的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 分布式机器人系统Distributed Robotic Systems&amp;lt;/font&amp;gt;'''不同，群体机器人技术强调需要大量的机器人并提高其可扩展性，例如仅使用本地通信连接。该本地通信包括可以通过无线传输系统实现，例如射频或红外。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该本地通信包括可以通过无线传输系统实现”改为“本地通信可以通过无线传输系统实现”&lt;br /&gt;
&lt;br /&gt;
== Goals and applications 目标与应用 ==&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow [[scalability]], making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow scalability, making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
微型化和成本是集群机器人技术的两大关键因素。它们会制约着大型机器人群体的构建；因此，单个团队成员的简单性就显得尤为重要。其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为。目前出现了大量关于单个机器人级别简单性目标的研究。如果能够在集群机器人技术研究中使用实际硬件操作而非通过仿真实现，就可以使研究人员遇到并解决更多问题，从而加深集群行为的研究。因此，开发用于集群智能研究的简单机器人是该领域发展中非常重要的环节。目标包括：降低单个机器人的成本，和提升它的可扩展性，从而使集群中的每个机器人对资源消耗更少，因此会提高其功率或能效。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为”改为“这些机器人应当从群体层面激发出群体智能方法，以产生有意义的行为，而非在个体层面各自运行”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“目前出现了大量关于单个机器人级别简单性目标的研究”改为“当下有很多针对于机器人简单性的个体层面的研究”&lt;br /&gt;
&lt;br /&gt;
Compared with individual robots, a swarm can commonly decompose its given missions to their subtasks; A swarm is more robust to partial swarm failure and is more flexible with regard to different missions&lt;br /&gt;
&lt;br /&gt;
与单个机器人相比，集群机器人通常可以将其给定的任务自行分解为子任务；对于部分集群指令失效的情况，集群机器人更加稳定，它们在执行不同任务时更为灵活。&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System&amp;lt;ref&amp;gt;{{citation|doi=10.1109/CYBER.2012.6392577|chapter=Libot: Design of a low cost mobile robot for outdoor swarm robotics|title=2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER)|pages=342–347|year=2012|last1=Zahugi|first1=Emaad Mohamed H.|last2=Shabani|first2=Ahmed M.|last3=Prasad|first3=T. V.|isbn=978-1-4673-1421-3}}&amp;lt;/ref&amp;gt; that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias),&amp;lt;ref&amp;gt;Arvin, F.; Murray, J.C.; Licheng Shi; Chun Zhang; Shigang Yue, &amp;quot;[https://www.researchgate.net/profile/Farshad_Arvin/publication/271545281_Development_of_an_autonomous_micro_robot_for_swarm_robotics/links/55e4bad008aede0b57357ed4.pdf Development of an autonomous micro robot for swarm robotics],&amp;quot; Mechatronics and Automation (ICMA), 2014 IEEE International Conference on , vol., no., pp.635,640, 3-6 Aug. 2014 doi: 10.1109/ICMA.2014.6885771&amp;lt;/ref&amp;gt; built in the Computer Intelligence Lab at the [[University of Lincoln]], UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias), built in the Computer Intelligence Lab at the University of Lincoln, UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
有一种叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; LIBOT机器人系统LIBOT Robotic System&amp;lt;/font&amp;gt;'''的集群系统，本质上是由一个低成本的机器人组成的户外的机器人群体。由于GPS传感器在建筑物内部通讯不畅，这些机器人同时配备了Wi-Fi设备。另外一个进行此类尝试的是个叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; Colias&amp;lt;/font&amp;gt;'''的微型机器人，该机器人在英国林肯大学的计算机智能实验室中建立。这款微型机器人建立在4厘米的圆形底盘上，其低成本和开放的平台使它兼容于各种集群机器人的应用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Applications 应用 ===&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand [[miniaturization]] ([[nanorobotics]], [[microbotics]]), like distributed sensing tasks in [[micromachinery]] or the [[human body]]. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance [[mining]] or agricultural [[foraging]] tasks.&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand miniaturization (nanorobotics, microbotics), like distributed sensing tasks in micromachinery or the human body. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance mining or agricultural foraging tasks.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的潜在应用很多。它们包括具有微型化需求的任务（纳米机器人，微生物学），比如微型机械或人体中的分布式传感任务。集群机器人技术最有前途的应用之一是在灾难救援任务中，大量不同尺寸的机器人可以被送到救援人员无法安全到达的地方，通过红外传感器探测生命的存在。另一方面，集群机器人技术也适合需要低廉经济的设计任务，例如采矿或农业采掘任务。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“纳米机器人，微生物学”改为“纳米级机器人，微米级机器人”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of [[military robot]]s can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&amp;lt;ref&amp;gt;{{cite web|url=http://www.cnn.com/2014/10/06/tech/innovation/navy-swarm-boats/index.html|title=U.S. Navy could 'swarm' foes with robot boats|first=Brad |last=Lendon|publisher=CNN}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of military robots can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&lt;br /&gt;
&lt;br /&gt;
除此之外，有争议的是军事集群机器人，它可以组成一支自主部队。美国海军已经对一大批可以自行操纵并采取进攻行为的自主舰艇进行了测试。这些船是无人驾驶的，可以安装任何种类的工具来威慑和摧毁敌方船只。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
During the [[Syrian Civil War]], Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&amp;lt;ref&amp;gt;{{Cite web|url=https://www.theatlantic.com/technology/archive/2018/03/drone-swarms-are-going-to-be-terrifying/555005/|title=Drone Swarms Are Going to Be Terrifying and Hard to Stop|last=Madrigal|first=Alexis C.|date=2018-03-07|website=The Atlantic|language=en-US|access-date=2019-03-07}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
During the Syrian Civil War, Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&lt;br /&gt;
&lt;br /&gt;
在叙利亚内战期间，该地区的俄罗斯部队报告指出，该国主要空军基地遭到装有炸药的固定翼无人机群袭击。&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&amp;lt;ref&amp;gt;{{cite web |title=A self-organizing thousand-robot swarm |url=http://www.seas.harvard.edu/news/2014/08/self-organizing-thousand-robot-swarm |work=Harvard |date=14 August 2014 |accessdate=16 August 2014 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&lt;br /&gt;
&lt;br /&gt;
目前大多数研究成果都集中在相对小规模的集群机体上。然而，哈佛大学在2014年展示了由1,024个机器人组成的群体，这是迄今为止规模最大的机器人群体。&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of [[micro air vehicle]]s, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise [[motion capture]] systems in laboratory conditions,&amp;lt;ref&amp;gt;Kushleyev, A.; Mellinger, D.; Powers, C.; Kumar, V., &amp;quot;[https://pdfs.semanticscholar.org/b063/239bd450038531eeb2db5466eaed34a0f9a0.pdf Towards a swarm of agile micro quadrotors]&amp;quot; Autonomous Robots, Volume 35, Issue 4, pp 287-300, November 2013&amp;lt;/ref&amp;gt; current systems such as [[Shooting Star (drone)|Shooting Star]] can control teams of hundreds of micro aerial vehicles in outdoor environment&amp;lt;ref&amp;gt;Vasarhelyi, G.; Virágh, C.; Tarcai, N.; Somorjai, G.; Vicsek, T. [https://arxiv.org/pdf/1402.3588 Outdoor flocking and formation flight with autonomous aerial robots]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), 2014&amp;lt;/ref&amp;gt; using [[Satellite navigation|GNSS]] systems (such as GPS) or even  stabilize them using onboard [[robot localization|localization]] systems&amp;lt;ref&amp;gt;Faigl, J.; Krajnik, T.; Chudoba, J.; Preucil, L.; Saska, M. [http://eprints.lincoln.ac.uk/13799/1/__ddat02_staffhome_jpartridge_camera_2013_ICRA.pdf Low-Cost Embedded System for Relative Localization in Robotic Swarms]. In ICRA2013: Proceedings of 2013 IEEE International Conference on Robotics and Automation. 2013.&amp;lt;/ref&amp;gt; where GPS is unavailable.&amp;lt;ref&amp;gt;Saska, M.; Vakula, J.; Preucil, L. [https://ieeexplore.ieee.org/abstract/document/6907374/ Swarms of Micro Aerial Vehicles Stabilized Under a Visual Relative Localization]. In ICRA2014: Proceedings of 2014 IEEE International Conference on Robotics and Automation. 2014.&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Saska, M. [https://www.researchgate.net/profile/Martin_Saska/publication/282922149_MAV-swarms_Unmanned_aerial_vehicles_stabilized_along_a_given_path_using_onboard_relative_localization/links/5684f75b08ae19758394dcdf.pdf MAV-swarms: unmanned aerial vehicles stabilized along a given path using onboard relative localization]. In Proceedings of 2015 International Conference on Unmanned Aircraft Systems (ICUAS). 2015&amp;lt;/ref&amp;gt;  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance,&amp;lt;ref&amp;gt;Saska, M.; Chudoba, J.; Preucil, L.; Thomas, J.; Loianno, G.; Tresnak, A.; Vonasek, V.; Kumar, V. [https://ieeexplore.ieee.org/abstract/document/6842301/ Autonomous Deployment of Swarms of Micro-Aerial Vehicles in Cooperative Surveillance]. In Proceedings of 2014 International Conference on Unmanned Aircraft Systems (ICUAS). 2014.&amp;lt;/ref&amp;gt; plume tracking,&amp;lt;ref&amp;gt;Saska, M.; Langr J.; L. Preucil. [https://www.researchgate.net/profile/Martin_Saska/publication/290558108_Plume_Tracking_by_a_Self-stabilized_Group_of_Micro_Aerial_Vehicles/links/57040e7908ae74a08e245eeb.pdf Plume Tracking by a Self-stabilized Group of Micro Aerial Vehicles]. In Modelling and Simulation for Autonomous Systems, 2014.&amp;lt;/ref&amp;gt; and reconnaissance in a compact phalanx.&amp;lt;ref&amp;gt;Saska, M.; Kasl, Z.; Preucil, L. [http://www.nt.ntnu.no/users/skoge/prost/proceedings/ifac2014/media/files/2295.pdf Motion Planning and Control of Formations of Micro Aerial Vehicles]. In Proceedings of the 19th World Congress of the International Federation of Automatic Control. 2014.&amp;lt;/ref&amp;gt;  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://labe.felk.cvut.cz/~tkrajnik/ardrone/articles/formace.pdf Coordination and Navigation of Heterogeneous UAVs-UGVs Teams Localized by a Hawk-Eye Approach]. In Proceedings of 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2012.&amp;lt;/ref&amp;gt; [[simultaneous localization and mapping]],&amp;lt;ref&amp;gt;Chung, Soon-Jo, et al. &amp;quot;[https://authors.library.caltech.edu/87925/1/tro-aerial-robotics_final.pdf A survey on aerial swarm robotics].&amp;quot; IEEE Transactions on Robotics 34.4 (2018): 837-855.&amp;lt;/ref&amp;gt; convoy protection,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://eprints.lincoln.ac.uk/14891/1/formations_2014_IJRR.pdf Coordination and Navigation of Heterogeneous MAV–UGV Formations Localized by a ‘hawk-eye’-like Approach Under a Model Predictive Control Scheme]. International Journal of Robotics Research 33(10):1393–1412, September 2014.&amp;lt;/ref&amp;gt; and moving target localization and tracking.&amp;lt;ref&amp;gt;Kwon, H; Pack, D. J. [https://link.springer.com/article/10.1007/s10846-011-9581-5 A Robust Mobile Target Localization Method for Cooperative Unmanned Aerial Vehicles Using Sensor Fusion Quality]. Journal of Intelligent and Robotic Systems, Volume 65, Issue 1, pp 479-493, January 2012.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of micro air vehicles, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise motion capture systems in laboratory conditions, current systems such as Shooting Star can control teams of hundreds of micro aerial vehicles in outdoor environment using GNSS systems (such as GPS) or even  stabilize them using onboard localization systems where GPS is unavailable.  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance, plume tracking, and reconnaissance in a compact phalanx.  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring, simultaneous localization and mapping, convoy protection, and moving target localization and tracking.&lt;br /&gt;
&lt;br /&gt;
通过集群飞行器还可以解决另一大类应用，该主题目前也得到了非常广泛的研究。在实验室条件下，相比较于过去使用的精密运动捕捉系统对飞行机器集群进行开创性研究，当前的系统（例如射星系统）则可以使用'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; GNSS全球导航卫星系统&amp;lt;/font&amp;gt;'''（Galeru Nagari Sujala Sravanthi Project, 如GPS全球定位系统）在室外环境条件下，控制数百台微型飞机集群，甚至可以使用GPS无法做到的机载定位系统来稳定它们。成群的微型飞行器已经可以在密集方阵中进行自主监视、羽毛跟踪以及侦察任务中进行测试。在协同无人驾驶地面和空中飞行器集群的大量工作中，已经涉及的应用包括：协同环境监测、即时定位与制图、车队保护、运动目标定位以及跟踪。&lt;br /&gt;
&lt;br /&gt;
== Drone displays 无人机显示器 ==&lt;br /&gt;
&lt;br /&gt;
{{main|Drone display}}&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
无人机显示器通常在夜间使用，通过多个点亮的无人机组合图像来进行艺术展示或广告宣传。&lt;br /&gt;
&lt;br /&gt;
== In popular culture 大众文化 ==&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's [[Big Hero 6 (film)|Big Hero 6]] involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's Big Hero 6 involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
迪士尼《超能陆战队》中有一个情节涉及使用成群的微型机器人来构建场景。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, [[Enthiran]], and its sequel [[2.0 (film)|2.0]].&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, Enthiran, and its sequel 2.0.&lt;br /&gt;
&lt;br /&gt;
在泰米尔语电影《宝莱坞机器人》及其续集2.0中使用了集群机器人技术。&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）只需要标注专业性较强的名词即可 超能陆战队和宝莱坞机器人这种类型的不需要标记  学术性的名词再进行标记 - 已修改&lt;br /&gt;
&lt;br /&gt;
== See also 其他参考资料 ==&lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent 自治主体（代理）]]&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics 基于行为的机器人学]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior) 群集行为(鸟类)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot （建议保持英文名字）]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies 新兴技术清单]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics 微型机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system 多主体系统]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics 纳米机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction 小说中的纳米技术]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics 拟态物理学]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials 机器人材料]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone) 射星（无人机）]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence 集群智慧]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms 集群机器人平台]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter 无人机/四轴飞行器]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{ columns-list | colwidth 22em | &lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent]]s&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone)]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter]]&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）这里的这些名词记得在新的自审清单中的词库进行查证和补充 - 已补充&lt;br /&gt;
&lt;br /&gt;
== References 参考文献==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|20em}}&lt;br /&gt;
&lt;br /&gt;
== External links 相关链接 ==&lt;br /&gt;
&lt;br /&gt;
* [https://www.youtube.com/watch?v=JzbWV1sfZ-A Fully decentralized robotic swarm performing collective search and exploration – Applied Complexity Group and Motion, Energy Control Lab at SUTD  ]&lt;br /&gt;
用于进行群体搜索和探测的全分布式机器人集群–应用复杂性群体和运动 - 新加坡科技设计大学能源控制实验室&lt;br /&gt;
&lt;br /&gt;
* [http://www.swarm-bots.org/ Swarm-bots: Swarms of self-assembling artifacts – EU IST-FET project (2001–2005)]&lt;br /&gt;
集群机器人：自组装构件的集群 – 欧盟IST-FET项目（2001–2005）&lt;br /&gt;
&lt;br /&gt;
* [http://www.aaaivideos.org/2007/morphogenesis/ Award-winning swarm-bot video at AAAI 2007]&lt;br /&gt;
在AAAI 2007上获奖的swarm-bot视频&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{collective animal behaviour}}&lt;br /&gt;
&lt;br /&gt;
{{Robotics}}&lt;br /&gt;
&lt;br /&gt;
{{emerging technologies|topics=yes|robotics=yes|manufacture=yes|materials=yes}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Category:Multi-robot systems]]&lt;br /&gt;
&lt;br /&gt;
Category:Multi-robot systems&lt;br /&gt;
&lt;br /&gt;
类别: 多机器人系统&lt;br /&gt;
&lt;br /&gt;
[[Category:Emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
Category:Emerging technologies&lt;br /&gt;
&lt;br /&gt;
类别: 新兴技术&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Swarm robotics]]. Its edit history can be viewed at [[集群机器人/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14119</id>
		<title>集群机器人</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14119"/>
		<updated>2020-09-20T11:58:32Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条已由Jie初步翻译&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{多个问题 |&lt;br /&gt;
&lt;br /&gt;
{{essay-like|date=May 2016}}&lt;br /&gt;
&lt;br /&gt;
{{more footnotes|date=August 2013}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
[[File:RechargingSwarm.jpg|thumb|right|Swarm of [[open-source]] Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
Swarm of [[open-source Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
一群开源茉莉微型机器人正在自行充电&lt;br /&gt;
&lt;br /&gt;
[[Image:IRobot Create team.jpg|thumb|right|A team of [[iRobot Create]] [[robot]]s at the [[Georgia Institute of Technology]]]]&lt;br /&gt;
&lt;br /&gt;
A team of [[iRobot Create robots at the Georgia Institute of Technology]]&lt;br /&gt;
&lt;br /&gt;
佐治亚理工学院的iRobot Create机器人团队&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Swarm robotics''' is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical [[robot]]s. It is supposed that a desired [[collective behavior]] emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of [[artificial swarm intelligence]], as well as the biological studies of insects, ants and other fields in nature, where [[swarm behaviour]] occurs.&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical robots. It is supposed that a desired collective behavior emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of artificial swarm intelligence, as well as the biological studies of insects, ants and other fields in nature, where swarm behaviour occurs.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 集群机器人技术 Swarm Robotics&amp;lt;/font&amp;gt;'''是通过某一种方法将多个机器人协调为一个系统，该系统由大量多数简单的物理机器人组成。该方法假定，在机器人之间以及机器人与环境之间的相互作用中，会产生一种预期的集体行为。该方法经常出现在人工群体智能领域，同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该系统由大量多数简单的物理机器人组成”改为“该系统由大量的、多数为简单的物理机器人组成”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括”中的“有所囊括”改为“有所帮助”&lt;br /&gt;
&lt;br /&gt;
== Definition 定义 ==&lt;br /&gt;
&lt;br /&gt;
The research of swarm [[robotics]] is to study the design of robots, their physical body and their controlling [[behaviour]]s. It is inspired but not limited by&amp;lt;ref&amp;gt;{{Cite web|url=https://theconversation.com/the-social-animals-that-are-inspiring-new-behaviours-for-robot-swarms-113584|title=The social animals that are inspiring new behaviours for robot swarms|last=Hunt|first=Edmund R.|date=2019-03-27|website=The Conversation|language=en-UK|access-date=2019-03-28}}&amp;lt;/ref&amp;gt; the [[emergent behaviour]] observed in [[social insect]]s, called [[swarm intelligence]]. Relatively simple individual rules can produce a large set of complex [[swarm behaviour]]s. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
The research of swarm robotics is to study the design of robots, their physical body and their controlling behaviours. It is inspired but not limited by the emergent behaviour observed in social insects, called swarm intelligence. Relatively simple individual rules can produce a large set of complex swarm behaviours. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的研究包括：机器人的设计，物理构造及其行为控制。它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能。相对简单的个体规则会产生大量复杂的群体行为。其关键组成部分是建立起持续反馈系统，该反馈系统主要来自于小组成员之间的无间断沟通。群体行为涉及到个体在合作中不断产生的变化，同时也包括整个群体展现出的行为表现。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能”改为“它受到社会性昆虫中观察到的新兴行为（被称为集群智能）的启发，并有所延伸”&lt;br /&gt;
&lt;br /&gt;
Unlike [[distributed robotic system]]s in general, swarm robotics emphasizes a ''large'' number of robots, and promotes [[scalability]], for instance by using only local communication.&amp;lt;ref&amp;gt;{{cite book|last=Hamann|first=H.|title=Swarm Robotics: A Formal Approach|url=https://books.google.com/books?id=pnNLDwAAQBAJ|year=2018|publisher=Springer International Publishing|location=New York|isbn=978-3-319-74528-2}}&amp;lt;/ref&amp;gt; That local communication for example can be achieved by [[wireless]] transmission systems, like [[radio frequency]] or [[infrared]].&amp;lt;ref&amp;gt;[http://correll.cs.colorado.edu/wp-content/uploads/correll_rus_chapter3.pdf N. Correll, D. Rus. Architectures and control of networked robotic systems. In: Serge Kernbach (Ed.): Handbook of Collective Robotics, pp. 81-104, Pan Stanford, Singapore, 2013.]&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Unlike distributed robotic systems in general, swarm robotics emphasizes a large number of robots, and promotes scalability, for instance by using only local communication. That local communication for example can be achieved by wireless transmission systems, like radio frequency or infrared.&lt;br /&gt;
&lt;br /&gt;
与一般的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 分布式机器人系统Distributed Robotic Systems&amp;lt;/font&amp;gt;'''不同，群体机器人技术强调需要大量的机器人并提高其可扩展性，例如仅使用本地通信连接。该本地通信包括可以通过无线传输系统实现，例如射频或红外。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该本地通信包括可以通过无线传输系统实现”改为“本地通信可以通过无线传输系统实现”&lt;br /&gt;
&lt;br /&gt;
== Goals and applications 目标与应用 ==&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow [[scalability]], making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow scalability, making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
微型化和成本是集群机器人技术的两大关键因素。它们会制约着大型机器人群体的构建；因此，单个团队成员的简单性就显得尤为重要。其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为。目前出现了大量关于单个机器人级别简单性目标的研究。如果能够在集群机器人技术研究中使用实际硬件操作而非通过仿真实现，就可以使研究人员遇到并解决更多问题，从而加深集群行为的研究。因此，开发用于集群智能研究的简单机器人是该领域发展中非常重要的环节。目标包括：降低单个机器人的成本，和提升它的可扩展性，从而使集群中的每个机器人对资源消耗更少，因此会提高其功率或能效。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为”改为“这些机器人应当从群体层面激发出群体智能方法，以产生有意义的行为，而非在个体层面各自运行”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“目前出现了大量关于单个机器人级别简单性目标的研究”改为“当下有很多针对于机器人简单性的个体层面的研究”&lt;br /&gt;
&lt;br /&gt;
Compared with individual robots, a swarm can commonly decompose its given missions to their subtasks; A swarm is more robust to partial swarm failure and is more flexible with regard to different missions&lt;br /&gt;
&lt;br /&gt;
与单个机器人相比，集群机器人通常可以将其给定的任务自行分解为子任务；对于部分集群指令失效的情况，集群机器人更加稳定，它们在执行不同任务时更为灵活。&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System&amp;lt;ref&amp;gt;{{citation|doi=10.1109/CYBER.2012.6392577|chapter=Libot: Design of a low cost mobile robot for outdoor swarm robotics|title=2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER)|pages=342–347|year=2012|last1=Zahugi|first1=Emaad Mohamed H.|last2=Shabani|first2=Ahmed M.|last3=Prasad|first3=T. V.|isbn=978-1-4673-1421-3}}&amp;lt;/ref&amp;gt; that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias),&amp;lt;ref&amp;gt;Arvin, F.; Murray, J.C.; Licheng Shi; Chun Zhang; Shigang Yue, &amp;quot;[https://www.researchgate.net/profile/Farshad_Arvin/publication/271545281_Development_of_an_autonomous_micro_robot_for_swarm_robotics/links/55e4bad008aede0b57357ed4.pdf Development of an autonomous micro robot for swarm robotics],&amp;quot; Mechatronics and Automation (ICMA), 2014 IEEE International Conference on , vol., no., pp.635,640, 3-6 Aug. 2014 doi: 10.1109/ICMA.2014.6885771&amp;lt;/ref&amp;gt; built in the Computer Intelligence Lab at the [[University of Lincoln]], UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias), built in the Computer Intelligence Lab at the University of Lincoln, UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
有一种叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; LIBOT机器人系统LIBOT Robotic System&amp;lt;/font&amp;gt;'''的集群系统，本质上是由一个低成本的机器人组成的户外的机器人群体。由于GPS传感器在建筑物内部通讯不畅，这些机器人同时配备了Wi-Fi设备。另外一个进行此类尝试的是个叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; Colias&amp;lt;/font&amp;gt;'''的微型机器人，该机器人在英国林肯大学的计算机智能实验室中建立。这款微型机器人建立在4厘米的圆形底盘上，其低成本和开放的平台使它兼容于各种集群机器人的应用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Applications 应用 ===&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand [[miniaturization]] ([[nanorobotics]], [[microbotics]]), like distributed sensing tasks in [[micromachinery]] or the [[human body]]. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance [[mining]] or agricultural [[foraging]] tasks.&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand miniaturization (nanorobotics, microbotics), like distributed sensing tasks in micromachinery or the human body. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance mining or agricultural foraging tasks.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的潜在应用很多。它们包括具有微型化需求的任务（纳米机器人，微生物学），比如微型机械或人体中的分布式传感任务。集群机器人技术最有前途的应用之一是在灾难救援任务中，大量不同尺寸的机器人可以被送到救援人员无法安全到达的地方，通过红外传感器探测生命的存在。另一方面，集群机器人技术也适合需要低廉经济的设计任务，例如采矿或农业采掘任务。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“纳米机器人，微生物学”改为“纳米级机器人，微米级机器人”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of [[military robot]]s can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&amp;lt;ref&amp;gt;{{cite web|url=http://www.cnn.com/2014/10/06/tech/innovation/navy-swarm-boats/index.html|title=U.S. Navy could 'swarm' foes with robot boats|first=Brad |last=Lendon|publisher=CNN}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of military robots can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&lt;br /&gt;
&lt;br /&gt;
除此之外，有争议的是军事集群机器人，它可以组成一支自主部队。美国海军已经对一大批可以自行操纵并采取进攻行为的自主舰艇进行了测试。这些船是无人驾驶的，可以安装任何种类的工具来威慑和摧毁敌方船只。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
During the [[Syrian Civil War]], Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&amp;lt;ref&amp;gt;{{Cite web|url=https://www.theatlantic.com/technology/archive/2018/03/drone-swarms-are-going-to-be-terrifying/555005/|title=Drone Swarms Are Going to Be Terrifying and Hard to Stop|last=Madrigal|first=Alexis C.|date=2018-03-07|website=The Atlantic|language=en-US|access-date=2019-03-07}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
During the Syrian Civil War, Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&lt;br /&gt;
&lt;br /&gt;
在叙利亚内战期间，该地区的俄罗斯部队报告指出，该国主要空军基地遭到装有炸药的固定翼无人机群袭击。&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&amp;lt;ref&amp;gt;{{cite web |title=A self-organizing thousand-robot swarm |url=http://www.seas.harvard.edu/news/2014/08/self-organizing-thousand-robot-swarm |work=Harvard |date=14 August 2014 |accessdate=16 August 2014 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&lt;br /&gt;
&lt;br /&gt;
目前大多数研究成果都集中在相对小规模的集群机体上。然而，哈佛大学在2014年展示了由1,024个机器人组成的群体，这是迄今为止规模最大的机器人群体。&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of [[micro air vehicle]]s, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise [[motion capture]] systems in laboratory conditions,&amp;lt;ref&amp;gt;Kushleyev, A.; Mellinger, D.; Powers, C.; Kumar, V., &amp;quot;[https://pdfs.semanticscholar.org/b063/239bd450038531eeb2db5466eaed34a0f9a0.pdf Towards a swarm of agile micro quadrotors]&amp;quot; Autonomous Robots, Volume 35, Issue 4, pp 287-300, November 2013&amp;lt;/ref&amp;gt; current systems such as [[Shooting Star (drone)|Shooting Star]] can control teams of hundreds of micro aerial vehicles in outdoor environment&amp;lt;ref&amp;gt;Vasarhelyi, G.; Virágh, C.; Tarcai, N.; Somorjai, G.; Vicsek, T. [https://arxiv.org/pdf/1402.3588 Outdoor flocking and formation flight with autonomous aerial robots]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), 2014&amp;lt;/ref&amp;gt; using [[Satellite navigation|GNSS]] systems (such as GPS) or even  stabilize them using onboard [[robot localization|localization]] systems&amp;lt;ref&amp;gt;Faigl, J.; Krajnik, T.; Chudoba, J.; Preucil, L.; Saska, M. [http://eprints.lincoln.ac.uk/13799/1/__ddat02_staffhome_jpartridge_camera_2013_ICRA.pdf Low-Cost Embedded System for Relative Localization in Robotic Swarms]. In ICRA2013: Proceedings of 2013 IEEE International Conference on Robotics and Automation. 2013.&amp;lt;/ref&amp;gt; where GPS is unavailable.&amp;lt;ref&amp;gt;Saska, M.; Vakula, J.; Preucil, L. [https://ieeexplore.ieee.org/abstract/document/6907374/ Swarms of Micro Aerial Vehicles Stabilized Under a Visual Relative Localization]. In ICRA2014: Proceedings of 2014 IEEE International Conference on Robotics and Automation. 2014.&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Saska, M. [https://www.researchgate.net/profile/Martin_Saska/publication/282922149_MAV-swarms_Unmanned_aerial_vehicles_stabilized_along_a_given_path_using_onboard_relative_localization/links/5684f75b08ae19758394dcdf.pdf MAV-swarms: unmanned aerial vehicles stabilized along a given path using onboard relative localization]. In Proceedings of 2015 International Conference on Unmanned Aircraft Systems (ICUAS). 2015&amp;lt;/ref&amp;gt;  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance,&amp;lt;ref&amp;gt;Saska, M.; Chudoba, J.; Preucil, L.; Thomas, J.; Loianno, G.; Tresnak, A.; Vonasek, V.; Kumar, V. [https://ieeexplore.ieee.org/abstract/document/6842301/ Autonomous Deployment of Swarms of Micro-Aerial Vehicles in Cooperative Surveillance]. In Proceedings of 2014 International Conference on Unmanned Aircraft Systems (ICUAS). 2014.&amp;lt;/ref&amp;gt; plume tracking,&amp;lt;ref&amp;gt;Saska, M.; Langr J.; L. Preucil. [https://www.researchgate.net/profile/Martin_Saska/publication/290558108_Plume_Tracking_by_a_Self-stabilized_Group_of_Micro_Aerial_Vehicles/links/57040e7908ae74a08e245eeb.pdf Plume Tracking by a Self-stabilized Group of Micro Aerial Vehicles]. In Modelling and Simulation for Autonomous Systems, 2014.&amp;lt;/ref&amp;gt; and reconnaissance in a compact phalanx.&amp;lt;ref&amp;gt;Saska, M.; Kasl, Z.; Preucil, L. [http://www.nt.ntnu.no/users/skoge/prost/proceedings/ifac2014/media/files/2295.pdf Motion Planning and Control of Formations of Micro Aerial Vehicles]. In Proceedings of the 19th World Congress of the International Federation of Automatic Control. 2014.&amp;lt;/ref&amp;gt;  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://labe.felk.cvut.cz/~tkrajnik/ardrone/articles/formace.pdf Coordination and Navigation of Heterogeneous UAVs-UGVs Teams Localized by a Hawk-Eye Approach]. In Proceedings of 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2012.&amp;lt;/ref&amp;gt; [[simultaneous localization and mapping]],&amp;lt;ref&amp;gt;Chung, Soon-Jo, et al. &amp;quot;[https://authors.library.caltech.edu/87925/1/tro-aerial-robotics_final.pdf A survey on aerial swarm robotics].&amp;quot; IEEE Transactions on Robotics 34.4 (2018): 837-855.&amp;lt;/ref&amp;gt; convoy protection,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://eprints.lincoln.ac.uk/14891/1/formations_2014_IJRR.pdf Coordination and Navigation of Heterogeneous MAV–UGV Formations Localized by a ‘hawk-eye’-like Approach Under a Model Predictive Control Scheme]. International Journal of Robotics Research 33(10):1393–1412, September 2014.&amp;lt;/ref&amp;gt; and moving target localization and tracking.&amp;lt;ref&amp;gt;Kwon, H; Pack, D. J. [https://link.springer.com/article/10.1007/s10846-011-9581-5 A Robust Mobile Target Localization Method for Cooperative Unmanned Aerial Vehicles Using Sensor Fusion Quality]. Journal of Intelligent and Robotic Systems, Volume 65, Issue 1, pp 479-493, January 2012.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of micro air vehicles, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise motion capture systems in laboratory conditions, current systems such as Shooting Star can control teams of hundreds of micro aerial vehicles in outdoor environment using GNSS systems (such as GPS) or even  stabilize them using onboard localization systems where GPS is unavailable.  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance, plume tracking, and reconnaissance in a compact phalanx.  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring, simultaneous localization and mapping, convoy protection, and moving target localization and tracking.&lt;br /&gt;
&lt;br /&gt;
通过集群飞行器还可以解决另一大类应用，该主题目前也得到了非常广泛的研究。在实验室条件下，相比较于过去使用的精密运动捕捉系统对飞行机器集群进行开创性研究，当前的系统（例如射星系统）则可以使用'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; GNSS全球导航卫星系统&amp;lt;/font&amp;gt;'''（Galeru Nagari Sujala Sravanthi Project, 如GPS全球定位系统）在室外环境条件下，控制数百台微型飞机集群，甚至可以使用GPS无法做到的机载定位系统来稳定它们。成群的微型飞行器已经可以在密集方阵中进行自主监视、羽毛跟踪以及侦察任务中进行测试。在协同无人驾驶地面和空中飞行器集群的大量工作中，已经涉及的应用包括：协同环境监测、即时定位与制图、车队保护、运动目标定位以及跟踪。&lt;br /&gt;
&lt;br /&gt;
== Drone displays 无人机显示器 ==&lt;br /&gt;
&lt;br /&gt;
{{main|Drone display}}&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
无人机显示器通常在夜间使用，通过多个点亮的无人机组合图像来进行艺术展示或广告宣传。&lt;br /&gt;
&lt;br /&gt;
== In popular culture 大众文化 ==&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's [[Big Hero 6 (film)|Big Hero 6]] involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's Big Hero 6 involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
迪士尼《超能陆战队》中有一个情节涉及使用成群的微型机器人来构建场景。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, [[Enthiran]], and its sequel [[2.0 (film)|2.0]].&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, Enthiran, and its sequel 2.0.&lt;br /&gt;
&lt;br /&gt;
在泰米尔语电影《宝莱坞机器人》及其续集2.0中使用了集群机器人技术。&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）只需要标注专业性较强的名词即可 超能陆战队和宝莱坞机器人这种类型的不需要标记  学术性的名词再进行标记 - 已修改&lt;br /&gt;
&lt;br /&gt;
== See also 其他参考资料 ==&lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent 自治主体（代理）]]&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics 基于行为的机器人学]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior) 群集行为(鸟类)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot （建议保持英文名字）]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies 新兴技术清单]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics 微型机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system 多主体系统]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics 纳米机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction 小说中的纳米技术]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics 拟态物理学]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials 机器人材料]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone) 射星（无人机）]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence 集群智慧]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms 集群机器人平台]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter 无人机/四轴飞行器]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{ columns-list | colwidth 22em | &lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent]]s&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone)]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter]]&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）这里的这些名词记得在新的自审清单中的词库进行查证和补充 - 已补充&lt;br /&gt;
&lt;br /&gt;
== References 参考文献==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|20em}}&lt;br /&gt;
&lt;br /&gt;
== External links 相关链接 ==&lt;br /&gt;
&lt;br /&gt;
* [https://www.youtube.com/watch?v=JzbWV1sfZ-A Fully decentralized robotic swarm performing collective search and exploration – Applied Complexity Group and Motion, Energy Control Lab at SUTD  ]&lt;br /&gt;
用于进行群体搜索和探测的全分布式机器人集群–应用复杂性群体和运动 - 新加坡科技设计大学能源控制实验室&lt;br /&gt;
&lt;br /&gt;
* [http://www.swarm-bots.org/ Swarm-bots: Swarms of self-assembling artifacts – EU IST-FET project (2001–2005)]&lt;br /&gt;
集群机器人：自组装构件的集群 – 欧盟IST-FET项目（2001–2005）&lt;br /&gt;
&lt;br /&gt;
* [http://www.aaaivideos.org/2007/morphogenesis/ Award-winning swarm-bot video at AAAI 2007]&lt;br /&gt;
在AAAI 2007上获奖的swarm-bot视频&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{collective animal behaviour}}&lt;br /&gt;
&lt;br /&gt;
{{Robotics}}&lt;br /&gt;
&lt;br /&gt;
{{emerging technologies|topics=yes|robotics=yes|manufacture=yes|materials=yes}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Category:Multi-robot systems]]&lt;br /&gt;
&lt;br /&gt;
Category:Multi-robot systems&lt;br /&gt;
&lt;br /&gt;
类别: 多机器人系统&lt;br /&gt;
&lt;br /&gt;
[[Category:Emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
Category:Emerging technologies&lt;br /&gt;
&lt;br /&gt;
类别: 新兴技术&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Swarm robotics]]. Its edit history can be viewed at [[集群机器人/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14118</id>
		<title>集群机器人</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E9%9B%86%E7%BE%A4%E6%9C%BA%E5%99%A8%E4%BA%BA&amp;diff=14118"/>
		<updated>2020-09-20T11:57:44Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条已由Jie初步翻译&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{{Multiple issues|&lt;br /&gt;
&lt;br /&gt;
{多个问题 |&lt;br /&gt;
&lt;br /&gt;
{{essay-like|date=May 2016}}&lt;br /&gt;
&lt;br /&gt;
{{more footnotes|date=August 2013}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
[[File:RechargingSwarm.jpg|thumb|right|Swarm of [[open-source]] Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
Swarm of [[open-source Jasmine micro-robots recharging themselves]]&lt;br /&gt;
&lt;br /&gt;
一群开源茉莉微型机器人正在自行充电&lt;br /&gt;
&lt;br /&gt;
[[Image:IRobot Create team.jpg|thumb|right|A team of [[iRobot Create]] [[robot]]s at the [[Georgia Institute of Technology]]]]&lt;br /&gt;
&lt;br /&gt;
A team of [[iRobot Create robots at the Georgia Institute of Technology]]&lt;br /&gt;
&lt;br /&gt;
佐治亚理工学院的iRobot Create机器人团队&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Swarm robotics''' is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical [[robot]]s. It is supposed that a desired [[collective behavior]] emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of [[artificial swarm intelligence]], as well as the biological studies of insects, ants and other fields in nature, where [[swarm behaviour]] occurs.&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is an approach to the coordination of multiple robots as a system which consist of large numbers of mostly simple physical robots. It is supposed that a desired collective behavior emerges from the interactions between the robots and interactions of robots with the environment. This approach emerged on the field of artificial swarm intelligence, as well as the biological studies of insects, ants and other fields in nature, where swarm behaviour occurs.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 集群机器人技术 Swarm Robotics&amp;lt;/font&amp;gt;'''是通过某一种方法将多个机器人协调为一个系统，该系统由大量多数简单的物理机器人组成。该方法假定，在机器人之间以及机器人与环境之间的相互作用中，会产生一种预期的集体行为。该方法经常出现在人工群体智能领域，同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该系统由大量多数简单的物理机器人组成”改为“该系统由大量的、多数为简单的物理机器人组成”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“同时对昆虫，蚂蚁和其他自然界中会发生群体行为的生物学研究领域也有所囊括”中的“有所囊括”改为“有所帮助”&lt;br /&gt;
&lt;br /&gt;
== Definition 定义 ==&lt;br /&gt;
&lt;br /&gt;
The research of swarm [[robotics]] is to study the design of robots, their physical body and their controlling [[behaviour]]s. It is inspired but not limited by&amp;lt;ref&amp;gt;{{Cite web|url=https://theconversation.com/the-social-animals-that-are-inspiring-new-behaviours-for-robot-swarms-113584|title=The social animals that are inspiring new behaviours for robot swarms|last=Hunt|first=Edmund R.|date=2019-03-27|website=The Conversation|language=en-UK|access-date=2019-03-28}}&amp;lt;/ref&amp;gt; the [[emergent behaviour]] observed in [[social insect]]s, called [[swarm intelligence]]. Relatively simple individual rules can produce a large set of complex [[swarm behaviour]]s. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
The research of swarm robotics is to study the design of robots, their physical body and their controlling behaviours. It is inspired but not limited by the emergent behaviour observed in social insects, called swarm intelligence. Relatively simple individual rules can produce a large set of complex swarm behaviours. A key-component is the communication between the members of the group that build a system of constant feedback. The swarm behaviour involves constant change of individuals in cooperation with others, as well as the behaviour of the whole group.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的研究包括：机器人的设计，物理构造及其行为控制。它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能。相对简单的个体规则会产生大量复杂的群体行为。其关键组成部分是建立起持续反馈系统，该反馈系统主要来自于小组成员之间的无间断沟通。群体行为涉及到个体在合作中不断产生的变化，同时也包括整个群体展现出的行为表现。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“它受到在社会性昆虫中观察到的涌现行为的启发，但是不受其限制，这种突发行为被称为集群智能”改为“它受到社会性昆虫中观察到的新兴行为（被称为集群智能）的启发，并有所延伸”&lt;br /&gt;
&lt;br /&gt;
Unlike [[distributed robotic system]]s in general, swarm robotics emphasizes a ''large'' number of robots, and promotes [[scalability]], for instance by using only local communication.&amp;lt;ref&amp;gt;{{cite book|last=Hamann|first=H.|title=Swarm Robotics: A Formal Approach|url=https://books.google.com/books?id=pnNLDwAAQBAJ|year=2018|publisher=Springer International Publishing|location=New York|isbn=978-3-319-74528-2}}&amp;lt;/ref&amp;gt; That local communication for example can be achieved by [[wireless]] transmission systems, like [[radio frequency]] or [[infrared]].&amp;lt;ref&amp;gt;[http://correll.cs.colorado.edu/wp-content/uploads/correll_rus_chapter3.pdf N. Correll, D. Rus. Architectures and control of networked robotic systems. In: Serge Kernbach (Ed.): Handbook of Collective Robotics, pp. 81-104, Pan Stanford, Singapore, 2013.]&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Unlike distributed robotic systems in general, swarm robotics emphasizes a large number of robots, and promotes scalability, for instance by using only local communication. That local communication for example can be achieved by wireless transmission systems, like radio frequency or infrared.&lt;br /&gt;
&lt;br /&gt;
与一般的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 分布式机器人系统Distributed Robotic Systems&amp;lt;/font&amp;gt;'''不同，群体机器人技术强调需要大量的机器人并提高其可扩展性，例如仅使用本地通信连接。该本地通信包括可以通过无线传输系统实现，例如射频或红外。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“该本地通信包括可以通过无线传输系统实现”改为“本地通信可以通过无线传输系统实现”&lt;br /&gt;
&lt;br /&gt;
== Goals and applications 目标与应用 ==&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow [[scalability]], making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
Miniaturization and cost are key factors in swarm robotics.  These are the constraints in building large groups of robots; therefore the simplicity of the individual team member should be emphasized.  This should motivate a swarm-intelligent approach to achieve meaningful behavior at swarm-level, instead of the individual level. &amp;lt;br /&amp;gt;Much research has been directed at this goal of simplicity at the individual robot level. Being able to use actual hardware in research of Swarm Robotics rather than simulations allows researchers to encounter and resolve many more issues and broaden the scope of Swarm Research.  Thus, development of simple robots for Swarm intelligence research is a very important aspect of the field.  The goals include keeping the cost of individual robots low to allow scalability, making each member of the swarm less demanding of resources and more power/energy efficient.&lt;br /&gt;
&lt;br /&gt;
微型化和成本是集群机器人技术的两大关键因素。它们会制约着大型机器人群体的构建；因此，单个团队成员的简单性就显得尤为重要。其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为。目前出现了大量关于单个机器人级别简单性目标的研究。如果能够在集群机器人技术研究中使用实际硬件操作而非通过仿真实现，就可以使研究人员遇到并解决更多问题，从而加深集群行为的研究。因此，开发用于集群智能研究的简单机器人是该领域发展中非常重要的环节。目标包括：降低单个机器人的成本，和提升它的可扩展性，从而使集群中的每个机器人对资源消耗更少，因此会提高其功率或能效。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“其目的是应该基于群体级别而非单一个体级别，来激发一种群体智能方法，去实现有意义的行为”改为“这些机器人应当从群体层面激发出群体智能方法，以产生有意义的行为，而非在个体层面各自运行”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“目前出现了大量关于单个机器人级别简单性目标的研究”改为“当下有很多针对于机器人简单性的个体层面的研究”&lt;br /&gt;
&lt;br /&gt;
Compared with individual robots, a swarm can commonly decompose its given missions to their subtasks; A swarm is more robust to partial swarm failure and is more flexible with regard to different missions&lt;br /&gt;
&lt;br /&gt;
与单个机器人相比，集群机器人通常可以将其给定的任务自行分解为子任务；对于部分集群指令失效的情况，集群机器人更加稳定，它们在执行不同任务时更为灵活。&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System&amp;lt;ref&amp;gt;{{citation|doi=10.1109/CYBER.2012.6392577|chapter=Libot: Design of a low cost mobile robot for outdoor swarm robotics|title=2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER)|pages=342–347|year=2012|last1=Zahugi|first1=Emaad Mohamed H.|last2=Shabani|first2=Ahmed M.|last3=Prasad|first3=T. V.|isbn=978-1-4673-1421-3}}&amp;lt;/ref&amp;gt; that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias),&amp;lt;ref&amp;gt;Arvin, F.; Murray, J.C.; Licheng Shi; Chun Zhang; Shigang Yue, &amp;quot;[https://www.researchgate.net/profile/Farshad_Arvin/publication/271545281_Development_of_an_autonomous_micro_robot_for_swarm_robotics/links/55e4bad008aede0b57357ed4.pdf Development of an autonomous micro robot for swarm robotics],&amp;quot; Mechatronics and Automation (ICMA), 2014 IEEE International Conference on , vol., no., pp.635,640, 3-6 Aug. 2014 doi: 10.1109/ICMA.2014.6885771&amp;lt;/ref&amp;gt; built in the Computer Intelligence Lab at the [[University of Lincoln]], UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
One such swarm system is the LIBOT Robotic System that involves a low cost robot built for outdoor swarm robotics. The robots are also made with provisions for indoor use via Wi-Fi, since the GPS sensors provide poor communication inside buildings.  Another such attempt is the micro robot (Colias), built in the Computer Intelligence Lab at the University of Lincoln, UK. This micro robot is built on a 4&amp;amp;nbsp;cm circular chassis and is low-cost and open platform for use in a variety of Swarm Robotics applications.&lt;br /&gt;
&lt;br /&gt;
有一种叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; LIBOT机器人系统LIBOT Robotic System&amp;lt;/font&amp;gt;'''的集群系统，本质上是由一个低成本的机器人组成的户外的机器人群体。由于GPS传感器在建筑物内部通讯不畅，这些机器人同时配备了Wi-Fi设备。另外一个进行此类尝试的是个叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; Colias&amp;lt;/font&amp;gt;'''的微型机器人，该机器人在英国林肯大学的计算机智能实验室中建立。这款微型机器人建立在4厘米的圆形底盘上，其低成本和开放的平台使它兼容于各种集群机器人的应用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
=== Applications 应用 ===&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand [[miniaturization]] ([[nanorobotics]], [[microbotics]]), like distributed sensing tasks in [[micromachinery]] or the [[human body]]. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance [[mining]] or agricultural [[foraging]] tasks.&lt;br /&gt;
&lt;br /&gt;
Potential applications for swarm robotics are many.  They include tasks that demand miniaturization (nanorobotics, microbotics), like distributed sensing tasks in micromachinery or the human body. One of the most promising uses of swarm robotics is in disaster rescue missions.  Swarms of robots of different sizes could be sent to places rescue workers can't reach safely, to detect the presence of life via infra-red sensors. On the other hand, swarm robotics can be suited to tasks that demand cheap designs, for instance mining or agricultural foraging tasks.&lt;br /&gt;
&lt;br /&gt;
集群机器人技术的潜在应用很多。它们包括具有微型化需求的任务（纳米机器人，微生物学），比如微型机械或人体中的分布式传感任务。集群机器人技术最有前途的应用之一是在灾难救援任务中，大量不同尺寸的机器人可以被送到救援人员无法安全到达的地方，通过红外传感器探测生命的存在。另一方面，集群机器人技术也适合需要低廉经济的设计任务，例如采矿或农业采掘任务。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]（[[用户讨论:Zengsihang|讨论]]） 【审校】“纳米机器人，微生物学”改为“纳米级机器人，微米级机器人”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of [[military robot]]s can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&amp;lt;ref&amp;gt;{{cite web|url=http://www.cnn.com/2014/10/06/tech/innovation/navy-swarm-boats/index.html|title=U.S. Navy could 'swarm' foes with robot boats|first=Brad |last=Lendon|publisher=CNN}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
More controversially, swarms of military robots can form an autonomous army.   U.S. Naval forces have tested a swarm of autonomous boats that can steer and take offensive actions by themselves. The boats are unmanned and can be fitted with any kind of kit to deter and destroy enemy vessels.&lt;br /&gt;
&lt;br /&gt;
除此之外，有争议的是军事集群机器人，它可以组成一支自主部队。美国海军已经对一大批可以自行操纵并采取进攻行为的自主舰艇进行了测试。这些船是无人驾驶的，可以安装任何种类的工具来威慑和摧毁敌方船只。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
During the [[Syrian Civil War]], Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&amp;lt;ref&amp;gt;{{Cite web|url=https://www.theatlantic.com/technology/archive/2018/03/drone-swarms-are-going-to-be-terrifying/555005/|title=Drone Swarms Are Going to Be Terrifying and Hard to Stop|last=Madrigal|first=Alexis C.|date=2018-03-07|website=The Atlantic|language=en-US|access-date=2019-03-07}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
During the Syrian Civil War, Russian forces in the region reported attacks on their main air force base in the country by swarms of fixed-wing drones loaded with explosives.&lt;br /&gt;
&lt;br /&gt;
在叙利亚内战期间，该地区的俄罗斯部队报告指出，该国主要空军基地遭到装有炸药的固定翼无人机群袭击。&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&amp;lt;ref&amp;gt;{{cite web |title=A self-organizing thousand-robot swarm |url=http://www.seas.harvard.edu/news/2014/08/self-organizing-thousand-robot-swarm |work=Harvard |date=14 August 2014 |accessdate=16 August 2014 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Most efforts have focused on relatively small groups of machines. However, a swarm consisting of 1,024 individual robots was demonstrated by Harvard in 2014, the largest to date.&lt;br /&gt;
&lt;br /&gt;
目前大多数研究成果都集中在相对小规模的集群机体上。然而，哈佛大学在2014年展示了由1,024个机器人组成的群体，这是迄今为止规模最大的机器人群体。&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of [[micro air vehicle]]s, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise [[motion capture]] systems in laboratory conditions,&amp;lt;ref&amp;gt;Kushleyev, A.; Mellinger, D.; Powers, C.; Kumar, V., &amp;quot;[https://pdfs.semanticscholar.org/b063/239bd450038531eeb2db5466eaed34a0f9a0.pdf Towards a swarm of agile micro quadrotors]&amp;quot; Autonomous Robots, Volume 35, Issue 4, pp 287-300, November 2013&amp;lt;/ref&amp;gt; current systems such as [[Shooting Star (drone)|Shooting Star]] can control teams of hundreds of micro aerial vehicles in outdoor environment&amp;lt;ref&amp;gt;Vasarhelyi, G.; Virágh, C.; Tarcai, N.; Somorjai, G.; Vicsek, T. [https://arxiv.org/pdf/1402.3588 Outdoor flocking and formation flight with autonomous aerial robots]. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), 2014&amp;lt;/ref&amp;gt; using [[Satellite navigation|GNSS]] systems (such as GPS) or even  stabilize them using onboard [[robot localization|localization]] systems&amp;lt;ref&amp;gt;Faigl, J.; Krajnik, T.; Chudoba, J.; Preucil, L.; Saska, M. [http://eprints.lincoln.ac.uk/13799/1/__ddat02_staffhome_jpartridge_camera_2013_ICRA.pdf Low-Cost Embedded System for Relative Localization in Robotic Swarms]. In ICRA2013: Proceedings of 2013 IEEE International Conference on Robotics and Automation. 2013.&amp;lt;/ref&amp;gt; where GPS is unavailable.&amp;lt;ref&amp;gt;Saska, M.; Vakula, J.; Preucil, L. [https://ieeexplore.ieee.org/abstract/document/6907374/ Swarms of Micro Aerial Vehicles Stabilized Under a Visual Relative Localization]. In ICRA2014: Proceedings of 2014 IEEE International Conference on Robotics and Automation. 2014.&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Saska, M. [https://www.researchgate.net/profile/Martin_Saska/publication/282922149_MAV-swarms_Unmanned_aerial_vehicles_stabilized_along_a_given_path_using_onboard_relative_localization/links/5684f75b08ae19758394dcdf.pdf MAV-swarms: unmanned aerial vehicles stabilized along a given path using onboard relative localization]. In Proceedings of 2015 International Conference on Unmanned Aircraft Systems (ICUAS). 2015&amp;lt;/ref&amp;gt;  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance,&amp;lt;ref&amp;gt;Saska, M.; Chudoba, J.; Preucil, L.; Thomas, J.; Loianno, G.; Tresnak, A.; Vonasek, V.; Kumar, V. [https://ieeexplore.ieee.org/abstract/document/6842301/ Autonomous Deployment of Swarms of Micro-Aerial Vehicles in Cooperative Surveillance]. In Proceedings of 2014 International Conference on Unmanned Aircraft Systems (ICUAS). 2014.&amp;lt;/ref&amp;gt; plume tracking,&amp;lt;ref&amp;gt;Saska, M.; Langr J.; L. Preucil. [https://www.researchgate.net/profile/Martin_Saska/publication/290558108_Plume_Tracking_by_a_Self-stabilized_Group_of_Micro_Aerial_Vehicles/links/57040e7908ae74a08e245eeb.pdf Plume Tracking by a Self-stabilized Group of Micro Aerial Vehicles]. In Modelling and Simulation for Autonomous Systems, 2014.&amp;lt;/ref&amp;gt; and reconnaissance in a compact phalanx.&amp;lt;ref&amp;gt;Saska, M.; Kasl, Z.; Preucil, L. [http://www.nt.ntnu.no/users/skoge/prost/proceedings/ifac2014/media/files/2295.pdf Motion Planning and Control of Formations of Micro Aerial Vehicles]. In Proceedings of the 19th World Congress of the International Federation of Automatic Control. 2014.&amp;lt;/ref&amp;gt;  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://labe.felk.cvut.cz/~tkrajnik/ardrone/articles/formace.pdf Coordination and Navigation of Heterogeneous UAVs-UGVs Teams Localized by a Hawk-Eye Approach]. In Proceedings of 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2012.&amp;lt;/ref&amp;gt; [[simultaneous localization and mapping]],&amp;lt;ref&amp;gt;Chung, Soon-Jo, et al. &amp;quot;[https://authors.library.caltech.edu/87925/1/tro-aerial-robotics_final.pdf A survey on aerial swarm robotics].&amp;quot; IEEE Transactions on Robotics 34.4 (2018): 837-855.&amp;lt;/ref&amp;gt; convoy protection,&amp;lt;ref&amp;gt;Saska, M.; Vonasek, V.; Krajnik, T.; Preucil, L. [http://eprints.lincoln.ac.uk/14891/1/formations_2014_IJRR.pdf Coordination and Navigation of Heterogeneous MAV–UGV Formations Localized by a ‘hawk-eye’-like Approach Under a Model Predictive Control Scheme]. International Journal of Robotics Research 33(10):1393–1412, September 2014.&amp;lt;/ref&amp;gt; and moving target localization and tracking.&amp;lt;ref&amp;gt;Kwon, H; Pack, D. J. [https://link.springer.com/article/10.1007/s10846-011-9581-5 A Robust Mobile Target Localization Method for Cooperative Unmanned Aerial Vehicles Using Sensor Fusion Quality]. Journal of Intelligent and Robotic Systems, Volume 65, Issue 1, pp 479-493, January 2012.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Another large set of applications may be solved using swarms of micro air vehicles, which are also broadly investigated nowadays.  In comparison with the pioneering studies of swarms of flying robots using precise motion capture systems in laboratory conditions, current systems such as Shooting Star can control teams of hundreds of micro aerial vehicles in outdoor environment using GNSS systems (such as GPS) or even  stabilize them using onboard localization systems where GPS is unavailable.  Swarms of micro aerial vehicles have been already tested in tasks of autonomous surveillance, plume tracking, and reconnaissance in a compact phalanx.  Numerous works on cooperative swarms of unmanned ground and aerial vehicles have been conducted with target applications of cooperative environment monitoring, simultaneous localization and mapping, convoy protection, and moving target localization and tracking.&lt;br /&gt;
&lt;br /&gt;
通过集群飞行器还可以解决另一大类应用，该主题目前也得到了非常广泛的研究。在实验室条件下，相比较于过去使用的精密运动捕捉系统对飞行机器集群进行开创性研究，当前的系统（例如射星系统）则可以使用'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; GNSS全球导航卫星系统&amp;lt;/font&amp;gt;'''（Galeru Nagari Sujala Sravanthi Project, 如GPS全球定位系统）在室外环境条件下，控制数百台微型飞机集群，甚至可以使用GPS无法做到的机载定位系统来稳定它们。成群的微型飞行器已经可以在密集方阵中进行自主监视、羽毛跟踪以及侦察任务中进行测试。在协同无人驾驶地面和空中飞行器集群的大量工作中，已经涉及的应用包括：协同环境监测、即时定位与制图、车队保护、运动目标定位以及跟踪。&lt;br /&gt;
&lt;br /&gt;
== Drone displays 无人机显示器 ==&lt;br /&gt;
&lt;br /&gt;
{{main|Drone display}}&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
A drone display commonly uses multiple, lighted drones at night for an artistic display or advertising.&lt;br /&gt;
&lt;br /&gt;
无人机显示器通常在夜间使用，通过多个点亮的无人机组合图像来进行艺术展示或广告宣传。&lt;br /&gt;
&lt;br /&gt;
== In popular culture 大众文化 ==&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's [[Big Hero 6 (film)|Big Hero 6]] involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
A major subplot of Disney's Big Hero 6 involved the use of swarms of microbots to form structures.&lt;br /&gt;
&lt;br /&gt;
迪士尼《超能陆战队》中有一个情节涉及使用成群的微型机器人来构建场景。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, [[Enthiran]], and its sequel [[2.0 (film)|2.0]].&lt;br /&gt;
&lt;br /&gt;
Swarm robotics is used in the Tamil film, Enthiran, and its sequel 2.0.&lt;br /&gt;
&lt;br /&gt;
在泰米尔语电影《宝莱坞机器人》及其续集2.0中使用了集群机器人技术。&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）只需要标注专业性较强的名词即可 超能陆战队和宝莱坞机器人这种类型的不需要标记  学术性的名词再进行标记 - 已修改&lt;br /&gt;
&lt;br /&gt;
== See also 其他参考资料 ==&lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent 自治主体（代理）]]&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics 基于行为的机器人学]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior) 群集行为(鸟类)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot （建议保持英文名字）]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies 新兴技术清单]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics 微型机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system 多主体系统]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics 纳米机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction 小说中的纳米技术]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics 拟态物理学]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials 机器人材料]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone) 射星（无人机）]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence 集群智慧]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms 集群机器人平台]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter 无人机/四轴飞行器]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
{ columns-list | colwidth 22em | &lt;br /&gt;
&lt;br /&gt;
*[[Ant robotics 蚁群机器人]]&lt;br /&gt;
&lt;br /&gt;
*[[Autonomous agent]]s&lt;br /&gt;
&lt;br /&gt;
*[[Behavior-based robotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Flocking (behavior)]] &lt;br /&gt;
&lt;br /&gt;
*[[Kilobot]]&lt;br /&gt;
&lt;br /&gt;
*[[List of emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
*[[Microbotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Multi-agent system]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanorobotics]]&lt;br /&gt;
&lt;br /&gt;
*[[Nanotechnology in fiction]]&lt;br /&gt;
&lt;br /&gt;
*[[Physicomimetics]]&lt;br /&gt;
&lt;br /&gt;
*[[Robotic materials]]&lt;br /&gt;
&lt;br /&gt;
*[[Shooting Star (drone)]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm intelligence]]&lt;br /&gt;
&lt;br /&gt;
*[[Swarm robotic platforms]]&lt;br /&gt;
&lt;br /&gt;
*[[Unmanned aerial vehicle]]/[[Quadcopter]]&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
  --[[用户:趣木木|趣木木]]（[[用户讨论:趣木木|讨论]]）这里的这些名词记得在新的自审清单中的词库进行查证和补充 - 已补充&lt;br /&gt;
&lt;br /&gt;
== References 参考文献==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|20em}}&lt;br /&gt;
&lt;br /&gt;
== External links 相关链接 ==&lt;br /&gt;
&lt;br /&gt;
* [https://www.youtube.com/watch?v=JzbWV1sfZ-A Fully decentralized robotic swarm performing collective search and exploration – Applied Complexity Group and Motion, Energy Control Lab at SUTD  ]&lt;br /&gt;
用于进行群体搜索和探测的全分布式机器人集群–应用复杂性群体和运动 - 新加坡科技设计大学能源控制实验室&lt;br /&gt;
&lt;br /&gt;
* [http://www.swarm-bots.org/ Swarm-bots: Swarms of self-assembling artifacts – EU IST-FET project (2001–2005)]&lt;br /&gt;
集群机器人：自组装构件的集群 – 欧盟IST-FET项目（2001–2005）&lt;br /&gt;
&lt;br /&gt;
* [http://www.aaaivideos.org/2007/morphogenesis/ Award-winning swarm-bot video at AAAI 2007]&lt;br /&gt;
在AAAI 2007上获奖的swarm-bot视频&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{collective animal behaviour}}&lt;br /&gt;
&lt;br /&gt;
{{Robotics}}&lt;br /&gt;
&lt;br /&gt;
{{emerging technologies|topics=yes|robotics=yes|manufacture=yes|materials=yes}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Category:Multi-robot systems]]&lt;br /&gt;
&lt;br /&gt;
Category:Multi-robot systems&lt;br /&gt;
&lt;br /&gt;
类别: 多机器人系统&lt;br /&gt;
&lt;br /&gt;
[[Category:Emerging technologies]]&lt;br /&gt;
&lt;br /&gt;
Category:Emerging technologies&lt;br /&gt;
&lt;br /&gt;
类别: 新兴技术&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Swarm robotics]]. Its edit history can be viewed at [[集群机器人/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13992</id>
		<title>数据挖掘</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13992"/>
		<updated>2020-09-13T14:41:37Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条由许菁翻译整理。&lt;br /&gt;
&lt;br /&gt;
{{Machine learning bar}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Data mining''' is the process of discovering patterns in large [[data set]]s involving methods at the intersection of [[machine learning]], [[statistics]], and [[database system]]s.&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; Data mining is an [[interdisciplinary]] subfield of [[computer science]] and [[statistics]] with an overall goal to extract information (with intelligent methods) from a data set and transform the information into a comprehensible structure for further use.&amp;lt;ref name=&amp;quot;acm&amp;quot;&amp;gt;{{cite web |url=http://www.kdd.org/curriculum/index.html |title=Data Mining Curriculum |publisher=[[Association for Computing Machinery|ACM]] [[SIGKDD]] |date=2006-04-30 |accessdate=2014-01-27 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;brittanica&amp;quot;&amp;gt;{{cite web |last=Clifton |first=Christopher |title=Encyclopædia Britannica: Definition of Data Mining |year=2010 |url=http://www.britannica.com/EBchecked/topic/1056150/data-mining |accessdate=2010-12-09 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;elements&amp;quot;&amp;gt;{{cite web|last1=Hastie|first1=Trevor|authorlink1=Trevor Hastie|last2=Tibshirani|first2=Robert|authorlink2=Robert Tibshirani|last3=Friedman|first3=Jerome|authorlink3=Jerome H. Friedman|title=The Elements of Statistical Learning: Data Mining, Inference, and Prediction|year=2009|url=http://www-stat.stanford.edu/~tibs/ElemStatLearn/|accessdate=2012-08-07|archive-url=https://web.archive.org/web/20091110212529/http://www-stat.stanford.edu/~tibs/ElemStatLearn/|archive-date=2009-11-10|url-status=dead}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book|last1=Han, Kamber, Pei|first1=Jaiwei, Micheline, Jian|title=Data Mining: Concepts and Techniques|date=June 9, 2011|publisher=Morgan Kaufmann|isbn=978-0-12-381479-1|edition=3rd}}&amp;lt;/ref&amp;gt; Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt; Aside from the raw analysis step, it also involves database and [[data management]] aspects, [[data pre-processing]], [[statistical model|model]] and [[Statistical inference|inference]] considerations, interestingness metrics, [[Computational complexity theory|complexity]] considerations, post-processing of discovered structures, [[Data visualization|visualization]], and [[Online algorithm|online updating]].&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; &lt;br /&gt;
&lt;br /&gt;
Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD. Aside from the raw analysis step, it also involves database and data management aspects, data pre-processing, model and inference considerations, interestingness metrics, complexity considerations, post-processing of discovered structures, visualization, and online updating. &lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘 Data Mining &amp;lt;/font&amp;gt;'''是在大型数据集中发现模式的过程，是一种涉及到机器学习、统计学和数据库系统综合使用的方法。数据挖掘是指“在数据库中知识发现KDD”过程中的分析步骤。除了传统的分析步骤，它还涉及数据库和数据管理方面，包括数据预处理、模型和推理考虑、兴趣度量、复杂性考虑、发现结构的后处理、可视化和在线更新等内容。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“数据挖掘是指“数据库中的知识发现KDD”的过程的分析步骤”一句中的“在数据库中知识发现KDD”处改为“数据库中的知识发现(knowledge discovery in databases,KDD)”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a [[misnomer]], because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (''mining'') of data itself.&amp;lt;ref name=&amp;quot;han-kamber&amp;quot;&amp;gt;{{cite book|title=Data mining: concepts and techniques|last1=Han|first1=Jiawei|last2=Kamber|first2=Micheline|date=2001|publisher=[[Morgan Kaufmann]]|isbn=978-1-55860-489-6|page=5|quote=Thus, data mining should have been more appropriately named &amp;quot;knowledge mining from data,&amp;quot; which is unfortunately somewhat long|authorlink1=Jiawei Han}}&amp;lt;/ref&amp;gt; It also is a [[buzzword]]&amp;lt;ref&amp;gt;[http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf OKAIRP 2005 Fall Conference, Arizona State University] {{Webarchive|url=https://web.archive.org/web/20140201170452/http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf|date=2014-02-01}}&amp;lt;/ref&amp;gt; and is frequently applied to any form of large-scale data or [[information processing]] ([[Data collection|collection]], [[information extraction|extraction]], [[Data warehouse|warehousing]], analysis, and statistics) as well as any application of [[Decision support system|computer decision support system]], including [[artificial intelligence]] (e.g., machine learning) and [[business intelligence]]. The book ''Data mining: Practical machine learning tools and techniques with Java''&amp;lt;ref name=&amp;quot;witten&amp;quot;&amp;gt;{{cite book|title=Data Mining: Practical Machine Learning Tools and Techniques|last1=Witten|first1=Ian H.|last2=Frank|first2=Eibe|last3=Hall|first3=Mark A.|date=30 January 2011|publisher=Elsevier|isbn=978-0-12-374856-0|edition=3|authorlink1=Ian H. Witten}}&amp;lt;/ref&amp;gt; (which covers mostly machine learning material) was originally to be named just ''Practical machine learning'', and the term ''data mining'' was only added for marketing reasons.&amp;lt;ref&amp;gt;{{Cite journal|author1=Bouckaert, Remco R.|author2=Frank, Eibe|author3=Hall, Mark A.|author4=Holmes, Geoffrey|author5=Pfahringer, Bernhard|author6=Reutemann, Peter|author7=Witten, Ian H.|authorlink7=Ian H. Witten|year=2010|title=WEKA Experiences with a Java open-source project|journal=Journal of Machine Learning Research|volume=11|pages=2533–2541|quote=the original title, &amp;quot;Practical machine learning&amp;quot;, was changed&amp;amp;nbsp;... The term &amp;quot;data mining&amp;quot; was [added] primarily for marketing reasons.|postscript={{inconsistent citations}}}}&amp;lt;/ref&amp;gt; Often the more general terms (''large scale'') ''[[data analysis]]'' and ''[[analytics]]'' – or, when referring to actual methods, ''artificial intelligence'' and ''machine learning'' – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a misnomer, because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (mining) of data itself. It also is a buzzword and is frequently applied to any form of large-scale data or information processing (collection, extraction, warehousing, analysis, and statistics) as well as any application of computer decision support system, including artificial intelligence (e.g., machine learning) and business intelligence. The book Data mining: Practical machine learning tools and techniques with Java (which covers mostly machine learning material) was originally to be named just Practical machine learning, and the term data mining was only added for marketing reasons. Often the more general terms (large scale) data analysis and analytics – or, when referring to actual methods, artificial intelligence and machine learning – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
“数据挖掘”这种形容其实并不十分恰当，因为我们的目标是从大量数据中提取模式和知识，而不是数据本身的提取(挖掘)。它是一个流行语，经常用于任何形式的大规模数据或信息处理（收集、提取、仓储、分析和统计）的场景下，以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 计算机决策系统 Decision Support System，DSS&amp;lt;/font&amp;gt;'''的任何应用当中，包括人工智能（例如机器学习）和商业智能。《数据挖掘：使用Java的实用机器学习工具和技术》（主要涵盖机器学习材料）一书最初被命名为“实用机器学习”，而数据挖掘一词只是为了营销的原因而增加。经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适”一句改为“经常来说，更一般的术语如（大规模）数据分析，或实际的方法如人工智能和机器学习，是更合适的表达方式”&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records ([[cluster analysis]]), unusual records ([[anomaly detection]]), and dependencies ([[association rule mining]], [[sequential pattern mining]]). This usually involves using database techniques such as [[spatial index|spatial indices]]. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and [[predictive analytics]]. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a [[decision support system]]. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records (cluster analysis), unusual records (anomaly detection), and dependencies (association rule mining, sequential pattern mining). This usually involves using database techniques such as spatial indices. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and predictive analytics. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a decision support system. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
实际上数据挖掘任务是对大量数据进行半自动或全自动分析，以提取出从前未知的且有趣的模式，如数据记录组(数据聚类)、异常记录组(异常检测)和依赖关系(关联规则挖掘，序列挖掘)。这通常涉及使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种汇总，并且可以用于进一步的分析，或者，例如，机器学习和预测分析。例如，数据挖掘步骤可以识别数据中的多个组，然后可以使用该步骤通过决策支持系统获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是作为附加步骤属于整个 KDD 过程。&lt;br /&gt;
&lt;br /&gt;
如数据记录组（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''）、异常记录（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly Detection&amp;lt;/font&amp;gt;'''）和依赖关系（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则挖掘 Association Rule Mining&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;序列模式挖掘 Sequential Pattern Mining&amp;lt;/font&amp;gt;'''）。这通常涉及到使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种规律总结，可以用于进一步的分析，或者，例如，在机器学习和预测分析中。例如，通过数据挖掘可以出识别数据中的多个组，然后这些组可以通过使用决策支持系统来获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是属于整个KDD过程的附加步骤。&lt;br /&gt;
&lt;br /&gt;
The difference between [[data analysis]] and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&amp;lt;ref&amp;gt;Olson, D. L. (2007). Data mining in business services. ''Service Business'', ''1''(3), 181-193. {{doi|10.1007/s11628-006-0014-7}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The difference between data analysis and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据分析 Data Analysis&amp;lt;/font&amp;gt;'''和数据挖掘的区别在于，数据分析用于测试数据集上的模型和假设，例如，分析营销活动的有效性，而不考虑数据量的多少；相反，数据挖掘使用机器学习和统计模型来发现“大量”数据中的秘密或隐藏模式。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The related terms ''[[data dredging]]'', ''data fishing'', and ''data snooping'' refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
The related terms data dredging, data fishing, and data snooping refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
相关术语'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;“数据疏浚” Data Dredging&amp;lt;/font&amp;gt;'''、“数据钓鱼”和“数据窥探”是指使用数据挖掘方法对较大的人口数据集中的一部分进行抽样，这些数据集太小（或可能太小），无法对所发现的任何模式的有效性作出可靠的统计推断。但是，这些方法可以用于提出新的假设，以针对更大的数据群体进行测试。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“使用数据挖掘方法对较大的人口数据集中的一部分进行抽样”中的“较大的人口数据集”改为“较大规模的数据集”&lt;br /&gt;
&lt;br /&gt;
==起源 Etymology==&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like ''data fishing'' or ''data dredging'' to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist [[Michael Lovell]] in an article published in the ''[[Review of Economic Studies]]'' in 1983.&amp;lt;ref&amp;gt;{{Cite journal|last=Lovell|first=Michael C.|date=1983|title=Data Mining|journal=The Review of Economics and Statistics|volume=65|issue=1|pages=1–12|doi=10.2307/1924403|jstor=1924403}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book |first=Wojciech W. |last=Charemza |first2=Derek F. |last2=Deadman |title=New Directions in Econometric Practice |location=Aldershot |publisher=Edward Elgar |year=1992 |chapter=Data Mining |pages=14–31 |isbn=1-85278-461-X }}&amp;lt;/ref&amp;gt; Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like data fishing or data dredging to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist Michael Lovell in an article published in the Review of Economic Studies in 1983. Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
在20世纪60年代，统计学家和经济学家们曾经使用“数据钓鱼”或”数据疏浚“等术语来指代他们认为在没有先验假设的情况下进行数据分析的糟糕做法。经济学家迈克尔•洛弗尔 Michael Lovell 在1983年《经济研究评论》（Review of Economic Studies）上发表的一篇文章中，也以类似的批判方式使用了“数据挖掘”这个术语。Lovell 指出，这种做法“伪装成各种别名，从“实验”(正面)到“钓鱼”或“窥探”(负面)。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term ''data mining'' appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation;&amp;lt;ref name=&amp;quot;Mena&amp;quot;&amp;gt;{{cite book |last=Mena |first=Jesús |year=2011 |title=Machine Learning Forensics for Law Enforcement, Security, and Intelligence |location=Boca Raton, FL |publisher=CRC Press (Taylor &amp;amp; Francis Group) |isbn=978-1-4398-6069-4 }}&amp;lt;/ref&amp;gt; researchers consequently turned to ''data mining''. Other terms used include ''data archaeology'', ''information harvesting'', ''information discovery'', ''knowledge extraction'', etc. [[Gregory I. Piatetsky-Shapiro|Gregory Piatetsky-Shapiro]] coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic [http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] and this term became more popular in [[Artificial intelligence|AI]] and [[machine learning]] community. However, the term data mining became more popular in the business and press communities.&amp;lt;ref&amp;gt;{{cite web |last1=Piatetsky-Shapiro |first1=Gregory |authorlink1=Gregory Piatetsky-Shapiro |last2=Parker |first2=Gary |url=http://www.kdnuggets.com/data_mining_course/x1-intro-to-data-mining-notes.html |title=Lesson: Data Mining, and Knowledge Discovery: An Introduction |publisher=KD Nuggets |year=2011 |work=Introduction to Data Mining |accessdate=30 August 2012 }}&amp;lt;/ref&amp;gt; Currently, the terms ''data mining'' and ''knowledge discovery'' are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
The term data mining appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation; researchers consequently turned to data mining. Other terms used include data archaeology, information harvesting, information discovery, knowledge extraction, etc. Gregory Piatetsky-Shapiro coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic (KDD-1989) and this term became more popular in AI and machine learning community. However, the term data mining became more popular in the business and press communities. Currently, the terms data mining and knowledge discovery are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
数据挖掘这个术语在1990年左右出现在数据库领域，通常有着积极的内涵。在20世纪80年代的一段短暂时间里，人们曾使用过“数据库挖掘”这种表达，但由于这个词被总部位于圣地亚哥的 HNC 公司注册为商标，因此研究人员转向了数据挖掘。曾用过的其他术语包括数据考古学、信息收集、信息发现、知识提取等。格雷戈里·皮亚特斯基·夏皮罗 Gregory Piatetsky-Shapiro 在关于这个主题的第一个研讨会[ http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] 上首次创造了“数据库中的知识发现 Knowledge Discovery in Databases，KDD”这个术语。此后，这个术语在人工智能和机器学习社区中变得更加流行。然而，数据挖掘这个术语在商业和出版界变得越来越流行。目前，数据挖掘和知识发现 knowledge discovery这两个术语可以互换使用。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“但由于这个词被总部位于圣地亚哥的 HNC 公司注册为商标”中的“总部位于圣地亚哥的HNC公司”改为“圣地亚哥的HNC公司”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“这个术语在人工智能和机器学习社区中变得更加流行”中的“社区”改为“群体”&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery ([[KDD-95]]) was started in Montreal under [[AAAI]] sponsorship. It was co-chaired by [[Usama Fayyad]] and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called [[Data Mining and Knowledge Discovery]] as its founding editor-in-chief. Later he started the [[SIGKDD]] Newsletter SIGKDD Explorations.&amp;lt;ref name=SIGKDD-explorations&amp;gt;{{cite journal|last1=Fayyad|first1=Usama|title=First Editorial by Editor-in-Chief|journal=SIGKDD Explorations|date=15 June 1999|volume=13|issue=1|pages=102|doi=10.1145/2207243.2207269|url=http://www.kdd.org/explorations/view/june-1999-volume-1-issue-1|accessdate=27 December 2010|ref=SIGKDD-explorations}}&amp;lt;/ref&amp;gt; The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal ''Data Mining and Knowledge Discovery'' is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery (KDD-95) was started in Montreal under AAAI sponsorship. It was co-chaired by Usama Fayyad and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called Data Mining and Knowledge Discovery as its founding editor-in-chief. Later he started the SIGKDD Newsletter SIGKDD Explorations.The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal Data Mining and Knowledge Discovery is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
在学术界，主要的研究论坛始于1995年，当时，在AAAI的赞助下，第一届数据挖掘和知识发现国际会议（KDD-95）在蒙特利尔召开。会议由乌萨马·法耶兹 Usama Fayyad和拉玛萨米·乌图鲁萨米 Ramasamy Uthurusamy共同主持。一年后，1996年Usama Fayyad创办了杂志《数据挖掘与知识发现》（datamining and Knowledge Discovery），担任创始主编。后来他创办了SIGKDD时事通讯探索。那个KDD国际会议也成为了数据挖掘领域质量最高的主要会议，其研究论文提交的接受率低于18%，而《数据挖掘与知识发现》也成为了该领域的主要研究期刊。&lt;br /&gt;
&lt;br /&gt;
==背景 Background==&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from [[data]] has occurred for centuries. Early methods of identifying patterns in data include [[Bayes' theorem]] (1700s) and [[regression analysis]] (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As [[data set]]s have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as [[neural networks]], [[cluster analysis]], [[genetic algorithms]] (1950s), [[decision tree learning|decision trees]] and [[decision rules]] (1960s), and [[support vector machines]] (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns&amp;lt;ref name=&amp;quot;Kantardzic&amp;quot;&amp;gt;{{cite book |last=Kantardzic |first=Mehmed |title=Data Mining: Concepts, Models, Methods, and Algorithms |year=2003 |publisher=John Wiley &amp;amp; Sons |isbn=978-0-471-22852-3 |oclc=50055336 |url-access=registration |url=https://archive.org/details/dataminingconcep0000kant }}&amp;lt;/ref&amp;gt; in large data sets. It bridges the gap from [[applied statistics]] and artificial intelligence (which usually provide the mathematical background) to [[database management]] by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from data has occurred for centuries. Early methods of identifying patterns in data include Bayes' theorem (1700s) and regression analysis (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As data sets have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as neural networks, cluster analysis, genetic algorithms (1950s), decision trees and decision rules (1960s), and support vector machines (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns in large data sets. It bridges the gap from applied statistics and artificial intelligence (which usually provide the mathematical background) to database management by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
从数据中手动提取模式的方法已经持续了好几个世纪了。早期识别数据模式的方法包括17世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;贝叶斯定理 Bayes' Theorem&amp;lt;/font&amp;gt;'''和19世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归分析 Regression Analysis&amp;lt;/font&amp;gt;'''。计算机技术的扩散、其普遍性和日益强大的能力极大地提高了数据的收集、存储和操作能力。随着数据集的规模和复杂性的增长，手动分析数据的方法越来越多地被更强的间接、自动化的数据处理所取代，这都得益于计算机科学其他领域取得的新的进步，特别是机器学习领域的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;神经网络 Neural Networks&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;遗传算法 Genetic Algorithms&amp;lt;/font&amp;gt;'''（1950年代），'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策树 Decision Tree&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策规则 Decision Rules&amp;lt;/font&amp;gt;'''（1960年代）以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;支持向量机 Support Vector Machines&amp;lt;/font&amp;gt;'''（1990年代）等。数据挖掘就是应用这些方法来发现大型数据集中的隐藏模式的过程。它利用数据在数据库中存储和索引的方式，更有效地执行实际的学习和发现算法，从而弥补了从应用统计学和人工智能(通常提供数学背景)到数据库管理之间的差距，使这些方法能够应用于更大的数据集。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“手动分析数据的方法越来越多地被更强的间接、自动化的数据处理所取代”中的“手动分析数据”改为“直接、手动的分析数据”&lt;br /&gt;
&lt;br /&gt;
==发展过程 Process==&lt;br /&gt;
&lt;br /&gt;
The ''knowledge discovery in databases (KDD) process'' is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
The knowledge discovery in databases (KDD) process is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
数据库中的知识发现 Knowledge Discovery in Databases ，KDD过程通常定义为以下几个阶段:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Selection&lt;br /&gt;
&lt;br /&gt;
 Selection&lt;br /&gt;
&lt;br /&gt;
选择&lt;br /&gt;
&lt;br /&gt;
# Pre-processing&lt;br /&gt;
&lt;br /&gt;
 Pre-processing&lt;br /&gt;
&lt;br /&gt;
预处理&lt;br /&gt;
&lt;br /&gt;
# Transformation&lt;br /&gt;
&lt;br /&gt;
 Transformation&lt;br /&gt;
&lt;br /&gt;
转换&lt;br /&gt;
&lt;br /&gt;
# ''Data mining''&lt;br /&gt;
&lt;br /&gt;
 Data mining&lt;br /&gt;
&lt;br /&gt;
数据挖掘&lt;br /&gt;
&lt;br /&gt;
# Interpretation/evaluation.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
 Interpretation/evaluation.&lt;br /&gt;
&lt;br /&gt;
解释 / 评估。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the [[Cross-industry standard process for data mining]] (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the Cross-industry standard process for data mining (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
然而，它存在于这个主题的许多变体中，例如在'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘的跨行业标准流程 Cross-industry standard process for data mining，CRISP-DM&amp;lt;/font&amp;gt;'''中它定义了以下六个阶段：&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Business understanding&lt;br /&gt;
&lt;br /&gt;
 Business understanding&lt;br /&gt;
&lt;br /&gt;
商业理解&lt;br /&gt;
&lt;br /&gt;
# Data understanding&lt;br /&gt;
&lt;br /&gt;
 Data understanding&lt;br /&gt;
&lt;br /&gt;
数据理解&lt;br /&gt;
&lt;br /&gt;
# Data preparation&lt;br /&gt;
&lt;br /&gt;
 Data preparation&lt;br /&gt;
&lt;br /&gt;
数据准备&lt;br /&gt;
&lt;br /&gt;
# Modeling&lt;br /&gt;
&lt;br /&gt;
 Modeling&lt;br /&gt;
&lt;br /&gt;
建模&lt;br /&gt;
&lt;br /&gt;
# Evaluation&lt;br /&gt;
&lt;br /&gt;
 Evaluation&lt;br /&gt;
&lt;br /&gt;
评估&lt;br /&gt;
&lt;br /&gt;
# Deployment&lt;br /&gt;
&lt;br /&gt;
 Deployment&lt;br /&gt;
&lt;br /&gt;
部署&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
或一个简化的过程，包括：(1)预处理，(2)数据挖掘，(3)结果验证。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners.&amp;lt;ref&amp;gt;[[Gregory Piatetsky-Shapiro]] (2002) [http://www.kdnuggets.com/polls/2002/methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2004) [http://www.kdnuggets.com/polls/2004/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2007) [http://www.kdnuggets.com/polls/2007/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2014) [http://www.kdnuggets.com/polls/2014/analytics-data-mining-data-science-methodology.html ''KDnuggets Methodology Poll'']&amp;lt;/ref&amp;gt; The only other data mining standard named in these polls was [[SEMMA]]. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models,&amp;lt;ref name=&amp;quot;kurgan&amp;quot;&amp;gt;Lukasz Kurgan and Petr Musilek (2006); [http://journals.cambridge.org/action/displayAbstract?fromPage=online&amp;amp;aid=451120 ''A survey of Knowledge Discovery and Data Mining process models'']. The Knowledge Engineering Review. Volume 21 Issue 1, March 2006, pp&amp;amp;nbsp;1–24, Cambridge University Press, New York, NY, USA {{DOI|10.1017/S0269888906000737}}&amp;lt;/ref&amp;gt; and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&amp;lt;ref name=&amp;quot;AzevedoSantos&amp;quot;&amp;gt;Azevedo, A. and Santos, M. F. [http://www.iadis.net/dl/final_uploads/200812P033.pdf KDD, SEMMA and CRISP-DM: a parallel overview] {{webarchive|url=https://web.archive.org/web/20130109114939/http://www.iadis.net/dl/final_uploads/200812P033.pdf |date=2013-01-09 }}. In Proceedings of the IADIS European Conference on Data Mining 2008, pp&amp;amp;nbsp;182–185.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners. The only other data mining standard named in these polls was SEMMA. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models, and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&lt;br /&gt;
&lt;br /&gt;
在这些调查中，唯一的其他数据挖掘标准是SEMMA。然而，使用CRISP-DM的人数是其3-4倍。一些研究小组已经发表了关于数据挖掘过程模型的研究，例如阿泽维多 Azevedo和 桑托斯Santos曾在2008年对CRISP-DM和SEMMA这两套数据挖掘流程标准进行了比较。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】开头添加“2002、2004、2007、2014年的调查显示，CRISP-DM标准是数据挖掘者最常用的标准”&lt;br /&gt;
&lt;br /&gt;
===预处理 Pre-processing===&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a [[data mart]] or [[data warehouse]]. Pre-processing is essential to analyze the [[Multivariate statistics|multivariate]] data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing [[statistical noise|noise]] and those with [[missing data]].&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a data mart or data warehouse. Pre-processing is essential to analyze the multivariate data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing noise and those with missing data.&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须先对目标数据集进行整合。由于数据挖掘只能发现数据中实际存在的模式，目标数据集必须足够大以包含这些模式，同时保持足够简洁以便在可接受的时间限制内进行挖掘。数据的公共源是数据集市或数据仓库。在数据挖掘之前，对多变量数据集进行预处理是必不可少的。然后清理目标集。数据清理去除了包含噪声的观测值和缺失数据的观测值。&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须组装目标数据集。由于数据挖掘只能发现数据中实际存在的模式，因此目标数据集必须足够大以包含这些模式，同时保持足够简洁，以便在可接受的时间限制内进行挖掘。数据的常见来源是'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据集市 Data Mart&amp;lt;/font&amp;gt;'''或'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据仓库 Data Warehouse&amp;lt;/font&amp;gt;'''。在数据挖掘之前，对'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;多元 Multivariate&amp;lt;/font&amp;gt;'''数据集进行预处理是必不可少的，然后对目标集进行清洗。数据清洗将删除包含'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;噪声 Noise&amp;lt;/font&amp;gt;'''的观测值和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;缺失数据 Missing Data&amp;lt;/font&amp;gt;'''的观测值。&lt;br /&gt;
&lt;br /&gt;
===数据挖掘 Data mining===&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&amp;lt;ref name=&amp;quot;Fayyad&amp;quot;&amp;gt;{{cite web |last1=Fayyad |first1=Usama |authorlink1=Usama Fayyad |last2=Piatetsky-Shapiro |first2=Gregory|authorlink2=Gregory Piatetsky-Shapiro |last3=Smyth |first3=Padhraic |title=From Data Mining to Knowledge Discovery in Databases |year=1996 |url=http://www.kdnuggets.com/gpspubs/aimag-kdd-overview-1996-Fayyad.pdf |accessdate = 17 December 2008 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&lt;br /&gt;
&lt;br /&gt;
数据挖掘涉及六类常见的任务:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection]] (outlier/change/deviation detection) – The identification of unusual data records, that might be interesting or data errors that require further investigation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly detection&amp;lt;/font&amp;gt;'''（异常值/变化/偏差检测）：识别异常数据记录，发现可能是有趣的或需要进一步调查的数据错误。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“发现可能是有趣的或需要进一步调查的数据错误”改为“这可能是有趣的信息或需要进一步调查的数据错误”&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]] (dependency modeling) – Searches for relationships between variables. For example, a supermarket might gather data on customer purchasing habits. Using association rule learning, the supermarket can determine which products are frequently bought together and use this information for marketing purposes. This is sometimes referred to as market basket analysis.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则学习 Association rule learning&amp;lt;/font&amp;gt;'''（依赖关系建模）：探变量之间的关系。例如，超市可能会收集顾客购买习惯的数据。通过使用关联规则学习，超市可以确定哪些产品经常被一起购买，并将这些信息用于营销策略改进。这种研究有时被称为“市场篮子分析”。&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis|Clustering]] – is the task of discovering groups and structures in the data that are in some way or another &amp;quot;similar&amp;quot;, without using known structures in the data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类 Clustering&amp;lt;/font&amp;gt;'''：是指在数据中发现以某种方式或其他方式“相似”的组和结构，而不使用数据中已知的结构。&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]] – is the task of generalizing known structure to apply to new data. For example, an e-mail program might attempt to classify an e-mail as &amp;quot;legitimate&amp;quot; or as &amp;quot;spam&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;分类 Classification&amp;lt;/font&amp;gt;'''：是将已知结构归纳为新数据的任务。例如，电子邮件程序可能会尝试将电子邮件分类为“合法”或“垃圾邮件”。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“是将已知结构归纳为新数据的任务”改为“是归纳已知结构并应用于新数据的任务”&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis|Regression]] – attempts to find a function that models the data with the least error that is, for estimating the relationships among data or datasets.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归&amp;lt;/font&amp;gt;'''：试图找到一个对数据建模误差最小的函数，也就是说，用于估计数据或数据集之间的关系。&lt;br /&gt;
&lt;br /&gt;
* [[Automatic summarization|Summarization]] – providing a more compact representation of the data set, including visualization and report generation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;自动文摘 Automatic summarizatio&amp;lt;/font&amp;gt;'''：提供数据集更紧凑、简洁的表示，包括可视化和报告生成。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“自动文摘 Automatic summarizatio”改为“总结 Summarization”&lt;br /&gt;
&lt;br /&gt;
===结果验证 Results validation===&lt;br /&gt;
&lt;br /&gt;
[[File:Spurious correlations - spelling bee spiders.svg|thumb|An example of data produced by [[data dredging]] through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence. 一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。]]&lt;br /&gt;
&lt;br /&gt;
An example of data produced by data dredging through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence.&lt;br /&gt;
&lt;br /&gt;
一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be [[Reproducibility|reproduced]] on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper [[statistical hypothesis testing]]. A simple version of this problem in [[machine learning]] is known as [[overfitting]], but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&amp;lt;ref name=hawkins&amp;gt;{{cite journal | last1 = Hawkins | first1 = Douglas M | year = 2004 | title = The problem of overfitting | url = | journal = Journal of Chemical Information and Computer Sciences | volume = 44 | issue = 1| pages = 1–12 | doi=10.1021/ci0342472| pmid = 14741005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be reproduced on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper statistical hypothesis testing. A simple version of this problem in machine learning is known as overfitting, but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&lt;br /&gt;
&lt;br /&gt;
数据挖掘可能会在无意中被误用，然后产生看似重要的结果; 但这些结果实际上并不能用来预测未来的行为，也不能在新的数据样本上进行复现，而且用处不大。这通常是由于调查了太多的假设，而没有进行适当的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;统计假设检验 Statistical Hypothesis Testing&amp;lt;/font&amp;gt;'''。在机器学习中，这种问题可以被简称为'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''，但相同的问题可能会在过程的不同阶段出现，因此，在完全适用的情况下，合理进行训练/测试分割这一种方法可能不足以防止这种情况的发生。&lt;br /&gt;
&lt;br /&gt;
{{Missing information|section|non-classification tasks in data mining. It only covers [[machine learning]]|date=September 2011}}&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called [[overfitting]]. To overcome this, the evaluation uses a [[test set]] of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a [[training set]] of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had ''not'' been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as [[Receiver operating characteristic|ROC curves]].&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called overfitting. To overcome this, the evaluation uses a test set of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a training set of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had not been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as ROC curves.&lt;br /&gt;
&lt;br /&gt;
从数据中发现知识的最后一步是验证数据挖掘算法产生的模式是否存在于更广泛的数据集中。数据挖掘算法发现的并非所有模式都是有效的，因为对于数据挖掘算法来说，在训练集中发现一般数据集中没有的模式是很常见的，这叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''。为了克服这个问题，评估使用一组测试数据，而数据挖掘算法并没有在这些测试数据上进行训练。然后将学习到的模式应用到这个'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;测试集 Test Set&amp;lt;/font&amp;gt;'''中，并将结果输出与期望的输出进行比较。例如，试图区分“垃圾邮件”和“合法”邮件的数据挖掘算法将根据一组电子邮件'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;训练集 Training Sett&amp;lt;/font&amp;gt;'''样本进行训练。训练完毕后，学到的模式将应用于未经训练的那部分电子邮件测试集数据上。然后，可以从这些模式正确分类的电子邮件数量来衡量这些模式的准确性。可以使用几种统计方法可以用来评估算法，如'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;ROC 曲线 ROC curves&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
如果学习的模式不能达到预期的标准，那么就需要重新评估和修改预处理和数据挖掘的步骤。如果所学的模式确实符合所需的标准，那么最后一步就是对习得的模式进行解释并将其转化为知识。&lt;br /&gt;
&lt;br /&gt;
==研究 Research==&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the [[Association for Computing Machinery]]'s (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining ([[SIGKDD]]).&amp;lt;ref&amp;gt;{{cite web|url=http://academic.research.microsoft.com/?SearchDomain=2&amp;amp;SubDomain=7&amp;amp;entitytype=2|title=Microsoft Academic Search: Top conferences in data mining | publisher=[[Microsoft Academic Search]]}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|url=https://scholar.google.de/citations?view_op=top_venues&amp;amp;hl=en&amp;amp;vq=eng_datamininganalysis|title=Google Scholar: Top publications - Data Mining &amp;amp; Analysis|publisher=[[Google Scholar]]}}&amp;lt;/ref&amp;gt; Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings,&amp;lt;ref&amp;gt;[http://www.kdd.org/conferences.php Proceedings] {{Webarchive|url=https://web.archive.org/web/20100430120252/http://www.kdd.org/conferences.php |date=2010-04-30 }}, International Conferences on Knowledge Discovery and Data Mining, ACM, New York.&amp;lt;/ref&amp;gt; and since 1999 it has published a biannual [[academic journal]] titled &amp;quot;SIGKDD Explorations&amp;quot;.&amp;lt;ref&amp;gt;[http://www.kdd.org/explorations/about.php SIGKDD Explorations], ACM, New York.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the Association for Computing Machinery's (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining (SIGKDD). Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings, and since 1999 it has published a biannual academic journal titled &amp;quot;SIGKDD Explorations&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
该领域的首要专业机构是计算机协会 ACM的知识发现和数据挖掘特别兴趣小组 SIGKDD。自1989年以来，ACM SIG每年举办一次国际会议并出版会议记录，自1999年起，它还出版了一份名为“SIGKDD探索”的两年期学术期刊。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
关于数据挖掘的计算机科学会议包括:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[CIKM Conference]] – ACM [[Conference on Information and Knowledge Management]]&lt;br /&gt;
&lt;br /&gt;
CIKM会议 ：ACM'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;信息和知识管理会议 Conference on Information and Knowledge Management&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
* [[European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases]]&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;欧洲机器学习与数据库知识发现原理与实践会议 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
* [[KDD Conference]] – ACM SIGKDD [[Conference on Knowledge Discovery and Data Mining]]&lt;br /&gt;
&lt;br /&gt;
KDD会议：ACM SIGKDD的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;知识发现与数据挖掘会议 Conference on Knowledge Discovery and Data Mining&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many [[List of computer science conferences#Data Management|data management/database conferences]] such as the ICDE Conference, [[SIGMOD|SIGMOD Conference]] and [[International Conference on Very Large Data Bases]]&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many data management/database conferences such as the ICDE Conference, SIGMOD Conference and International Conference on Very Large Data Bases.&lt;br /&gt;
&lt;br /&gt;
数据挖掘专题也出现在许多数据管理/数据库会议上，如 ICDE会议、 '''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;SIGMOD会议 SIGMOD Conference&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关于超大数据库国际会议International Conference on Very Large Data Bases&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
==标准 Standards==&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European [[Cross Industry Standard Process for Data Mining]] (CRISP-DM 1.0) and the 2004 [[Java Data Mining]] standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European Cross Industry Standard Process for Data Mining (CRISP-DM 1.0) and the 2004 Java Data Mining standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
为数据挖掘过程定义了一些标准，例如1999年欧洲跨行业数据挖掘标准流程（CRISP-DM 1.0）和2004年Java数据挖掘标准（JDM 1.0）。这些程序的后续程序（CRISP-DM 2.0和 JDM 2.0）的开发活跃于2006年，但此后一直停滞不前。Jdm 2.0没有达成最终草案就被撤销了。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】将“为数据挖掘过程定义了一些标准”改为“人们曾努力为数据挖掘过程定义标准&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in [[predictive analytics]]&amp;amp;nbsp;– the key standard is the [[Predictive Model Markup Language]] (PMML), which is an [[XML]]-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) [[subspace clustering]] have been proposed independently of the DMG.&amp;lt;ref&amp;gt;{{Cite book | last1 = Günnemann | first1 = Stephan | last2 = Kremer | first2 = Hardy | last3 = Seidl | first3 = Thomas | doi = 10.1145/2023598.2023605 | chapter = An extension of the PMML standard to subspace clustering models | title = Proceedings of the 2011 workshop on Predictive markup language modeling - PMML '11 | pages = 48 | year = 2011 | isbn = 978-1-4503-0837-3 | pmid =  | pmc = }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in predictive analytics&amp;amp;nbsp;– the key standard is the Predictive Model Markup Language (PMML), which is an XML-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) subspace clustering have been proposed independently of the DMG.&lt;br /&gt;
&lt;br /&gt;
为了交换所提取的模型，特别是在预测分析中使用，关键的标准是预测模型标记语言 PMML，这是一种基于 XML 的语言，由数据挖掘集团 DMG 开发，并支持作为交换格式的许多数据挖掘应用程序。顾名思义，它只涵盖预测模型，这是一项对业务应用程序非常重要的特殊数据挖掘任务。然而，覆盖子空间聚类的扩展已经独立于 DMG 被提出。&lt;br /&gt;
&lt;br /&gt;
==显著用途 Notable uses==&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable [[examples of data mining]] can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable examples of data mining can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
数据挖掘在任何有数字数据可用的地方都可以被使用。数据挖掘的著名例子可以在商业、医学、科学和监控领域找到。&lt;br /&gt;
&lt;br /&gt;
==隐私问题和道德规范 Privacy concerns and ethics==&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&amp;lt;ref&amp;gt;{{cite journal |author=Seltzer, William |title=The Promise and Pitfalls of Data Mining: Ethical Issues |url=https://ww2.amstat.org/committees/ethics/linksdir/Jsm2005Seltzer.pdf|publisher = American Statistical Association|journal = ASA Section on Government Statistics|date = 2005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&lt;br /&gt;
&lt;br /&gt;
虽然“数据挖掘”这个术语本身可能没有伦理含义，但它通常与人们行为（伦理和其他）相关的信息挖掘有关。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding [[privacy]], legality, and ethics.&amp;lt;ref&amp;gt;{{cite journal |author=Pitts, Chip |title=The End of Illegal Domestic Spying? Don't Count on It |url=http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |journal=Washington Spectator |date=15 March 2007 |url-status=dead |archiveurl=https://web.archive.org/web/20071128015201/http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |archivedate=2007-11-28 }}&amp;lt;/ref&amp;gt; In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the [[Total Information Awareness]] Program or in [[ADVISE]], has raised privacy concerns.&amp;lt;ref&amp;gt;{{cite journal |author=Taipale, Kim A. |title=Data Mining and Domestic Security: Connecting the Dots to Make Sense of Data |url=http://www.stlr.org/cite.cgi?volume=5&amp;amp;article=2 |journal=Columbia Science and Technology Law Review |volume=5 |issue=2 |date=15 December 2003 |ssrn=546782 |oclc=45263753 }}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|last1=Resig|first1=John|title=A Framework for Mining Instant Messaging Services|url=https://johnresig.com/files/research/SIAMPaper.pdf|accessdate=16 March 2018}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding privacy, legality, and ethics. In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the Total Information Awareness Program or in ADVISE, has raised privacy concerns.&lt;br /&gt;
&lt;br /&gt;
在某些情况下，数据挖掘的使用方式可能会引发隐私、合法性和伦理问题。特别是，为国家安全或执法目的而进行的政府或商业数据集的数据挖掘，如在全面信息意识项目或在 ADVISE 中，引起了隐私问题。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through [[aggregate function|data aggregation]]. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent).&amp;lt;ref name=&amp;quot;NASCIO&amp;quot;&amp;gt;[http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf ''Think Before You Dig: Privacy Implications of Data Mining &amp;amp; Aggregation''] {{webarchive|url=https://web.archive.org/web/20081217063043/http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf |date=2008-12-17 }}, NASCIO Research Brief, September 2004&amp;lt;/ref&amp;gt; This is not data mining ''per se'', but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&amp;lt;ref&amp;gt;{{cite magazine |first=Paul |last=Ohm |title=Don't Build a Database of Ruin |magazine=Harvard Business Review |url=http://blogs.hbr.org/cs/2012/08/dont_build_a_database_of_ruin.html}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/12/03/iron-cagebook/ Iron Cagebook - The Logical End of Facebook's Patents], [[Counterpunch.org]], 2013.12.03&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/09/11/inside-the-tech-industrys-startup-conference/ Inside the Tech industry's Startup Conference], [[Counterpunch.org]], 2013.09.11&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through data aggregation. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent). This is not data mining per se, but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&lt;br /&gt;
&lt;br /&gt;
数据挖掘需要进行数据准备，以发现损害机密性和隐私义务的信息或模式。实现这一点的一种常见方式是通过'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据聚合 Data Aggregation&amp;lt;/font&amp;gt;'''。数据聚合包括以一种便于分析的方式将数据（可能来自不同的来源）组合在一起（但这也可能使私人、个人级别的数据的识别变得可推断或以其他方式显而易见）。但这并不是数据挖掘本身，而是在分析之前以及为分析目的准备数据的结果。当数据被编译后，数据挖掘者或任何有权访问新编译的数据集的人能够识别特定的个人，特别是当数据最初是匿名的时，对个人隐私的威胁就开始发挥作用了。&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】将“对个人隐私的威胁就开始发挥作用了”改为“就会产生对个人隐私的威胁”&lt;br /&gt;
&lt;br /&gt;
It is recommended{{whom|date=August 2019}} to be aware of the following '''before''' data are collected:&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
It is recommended to be aware of the following before data are collected:&lt;br /&gt;
&lt;br /&gt;
在收集数据之前，建议注意以下事项:&lt;br /&gt;
&lt;br /&gt;
* The purpose of the data collection and any (known) data mining projects;&lt;br /&gt;
&lt;br /&gt;
数据收集和任何（已知的）数据挖掘项目的目的；&lt;br /&gt;
&lt;br /&gt;
* How the data will be used;&lt;br /&gt;
&lt;br /&gt;
数据使用的方法；&lt;br /&gt;
&lt;br /&gt;
* Who will be able to mine the data and use the data and their derivatives;&lt;br /&gt;
&lt;br /&gt;
谁将能够挖掘数据并使用这些数据及其衍生工具；&lt;br /&gt;
&lt;br /&gt;
* The status of security surrounding access to the data;&lt;br /&gt;
&lt;br /&gt;
数据访问的安全状态；&lt;br /&gt;
&lt;br /&gt;
* How collected data can be updated.&lt;br /&gt;
&lt;br /&gt;
如何更新收集的数据。&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to ''become'' anonymous, so that individuals may not readily be identified.&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt; However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&amp;lt;ref&amp;gt;[http://www.securityfocus.com/brief/277 ''AOL search data identified individuals''], SecurityFocus, August 2006&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to become anonymous, so that individuals may not readily be identified.However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&lt;br /&gt;
&lt;br /&gt;
数据也可以被修改成匿名的，这样个人就不容易被修改了确定。但是，甚至“匿名化”的数据集也可能包含足够的信息用来识别个人，就像记者能够根据一组无意中搜索历史找到几个个人一样美国在线发布。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】将“这样个人就不容易被修改了确定”改为“这样个人就不会轻易的被识别”&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】将“就像记者能够根据一组无意中搜索历史找到几个个人一样美国在线发布”改为“就像记者能够依据‘美国在线’无意中发布的用户历史记录找到一些个人”&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of [[personally identifiable information]] leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of [[privacy violation]], the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&amp;lt;ref&amp;gt;{{Cite journal|title = Big data׳s impact on privacy, security and consumer welfare|journal = Telecommunications Policy|pages = 1134–1145|volume = 38|issue = 11|doi = 10.1016/j.telpol.2014.10.002|first = Nir|last = Kshetri|year = 2014|url = http://libres.uncg.edu/ir/uncg/f/N_Kshetri_Big_2014.pdf}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of personally identifiable information leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of privacy violation, the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
无意中泄露个人身份信息导致提供者违反了公平信息惯例。这种轻率的行为会对指定的个人造成经济、情感或身体伤害。在一起侵犯隐私的案例中，沃尔格林 Walgreens的赞助人在2011年对该公司提起诉讼，指控该公司向数据挖掘公司出售处方信息，而数据挖掘公司又将这些数据提供给制药公司。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲的情况 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[European Union|Europe]] has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the [[International Safe Harbor Privacy Principles|U.S.-E.U. Safe Harbor Principles]], developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of [[Edward Snowden]]'s [[global surveillance disclosure]], there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the [[National Security Agency]], and attempts to reach an agreement with the United States have failed.&amp;lt;ref&amp;gt;{{cite web |url=https://crsreports.congress.gov/product/pdf/R/R44257/7 |title=U.S.-E.U. Data Privacy: From Safe Harbor to Privacy Shield |last1=Weiss |first1=Martin A. |last2=Archick |first2=Kristin |date=19 May 2016 |department= |website= |series= |agency=Congressional Research Service |location=Washington, D.C. |page=6 |pages= |format=PDF |id=R44257 |access-date=9 April 2020 |quote=On October 6, 2015, the [[Court of Justice of the European Union|CJEU]]&amp;amp;nbsp;... issued a decision that invalidated Safe Harbor (effective immediately), as currently implemented. }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Europe has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the U.S.-E.U. Safe Harbor Principles, developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of Edward Snowden's global surveillance disclosure, there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the National Security Agency, and attempts to reach an agreement with the United States have failed.&lt;br /&gt;
&lt;br /&gt;
欧洲有相当强的隐私法，正在努力进一步加强消费者的权利。然而，1998年至2000年期间制定的《美国-欧盟安全港原则》（U.S.-E.U.Safe Harbor Principles）目前有效地使欧洲用户受到美国公司的隐私剥削。由于爱德华·斯诺登 Edward Snowden披露了全球监控信息后，关于撤销这一协议的讨论越来越多，尤其是数据将完全暴露给国家安全局，与美国达成协议的尝试也失败了。&lt;br /&gt;
&lt;br /&gt;
===美国的情况 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the [[US Congress]] via the passage of regulatory controls such as the [[Health Insurance Portability and Accountability Act]] (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in ''Biotech Business Week'', &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot;&amp;lt;ref&amp;gt;Biotech Business Week Editors (June 30, 2008); ''BIOMEDICINE; HIPAA Privacy Rule Impedes Biomedical Research'', Biotech Business Week, retrieved 17 November 2009 from LexisNexis Academic&amp;lt;/ref&amp;gt; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the US Congress via the passage of regulatory controls such as the Health Insurance Portability and Accountability Act (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in Biotech Business Week, &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
在美国，美国国会通过了《健康保险便携性和责任法案》（HIPAA）等监管措施，解决了隐私问题。HIPAA要求个人就其提供的信息及其当前和未来的预期用途给予“知情同意”。根据《生物技术商业周刊》的一篇文章，“在实践中，HIPAA可能不会比研究领域长期存在的法规提供更大的保护。”。更重要的是，该规则通过知情同意进行保护的目标是接近普通个人的不可理解程度。”这突出了数据聚合和挖掘实践中数据匿名的必要性。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the [[Family Educational Rights and Privacy Act]] (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the Family Educational Rights and Privacy Act (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
美国信息隐私立法，如 HIPAA 和《家庭教育权利和隐私法》（FERPA）仅适用于每一个此类法律所涉及的特定领域。美国大多数企业对数据挖掘的使用并不受任何法律的控制。&lt;br /&gt;
&lt;br /&gt;
== 数据挖掘与著作权法 Copyright law==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Under [[Copyright law of the European Union|European copyright]] and [[Database Directive|database law]]s, the mining of in-copyright works (such as by [[web mining]]) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright{{snd}} but database rights may exist so data mining becomes subject to [[intellectual property]] owners' rights that are protected by the [[Database Directive]]. On the recommendation of the [[Hargreaves review]], this led to the UK government to amend its copyright law in 2014 to allow content mining as a [[Limitations and exceptions to copyright|limitation and exception]].&amp;lt;ref&amp;gt;[http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ UK Researchers Given Data Mining Right Under New UK Copyright Laws.] {{webarchive |url=https://web.archive.org/web/20140609020315/http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ |date=June 9, 2014 }} ''Out-Law.com.''   Retrieved 14 November 2014&amp;lt;/ref&amp;gt; The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the [[Information Society Directive]] (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
Under European copyright and database laws, the mining of in-copyright works (such as by web mining) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright but database rights may exist so data mining becomes subject to intellectual property owners' rights that are protected by the Database Directive. On the recommendation of the Hargreaves review, this led to the UK government to amend its copyright law in 2014 to allow content mining as a limitation and exception. The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the Information Society Directive (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
根据欧洲版权法和数据库法，未经版权所有人许可而对版权作品进行挖掘（如通过网络挖掘）是不合法的。在欧洲，如果数据库是纯数据，可能没有版权，但数据库权利可能存在，因此数据挖掘受数据库指令保护的知识产权所有者的权利约束。根据《哈格里夫斯评论》（Hargreaves review）的建议，这导致英国政府在2014年修订了版权法，允许将内容挖掘作为一种限制和例外。英国是继日本之后世界上第二个这样做的国家，日本在2009年引入了数据挖掘的例外。然而，由于信息社会指令（2001年）的限制，英国是例外情况但是只允许非商业目的的内容挖掘。英国版权法也不允许合同条款和条件推翻这一规定。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】将“英国是例外情况但是只允许给商业目的的内容挖掘”改为“英国对于内容挖掘的例外只允许非商业目的的内容挖掘”&lt;br /&gt;
&lt;br /&gt;
The [[European Commission]] facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe.&amp;lt;ref&amp;gt;{{cite web|title=Licences for Europe - Structured Stakeholder Dialogue 2013|url=http://ec.europa.eu/licences-for-europe-dialogue/en/content/about-site|website=European Commission|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt; The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and [[open access]] publishers to leave the stakeholder dialogue in May 2013.&amp;lt;ref&amp;gt;{{cite web|title=Text and Data Mining:Its importance and the need for change in Europe|url=http://libereurope.eu/news/text-and-data-mining-its-importance-and-the-need-for-change-in-europe/|website=Association of European Research Libraries|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The European Commission facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe. The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and open access publishers to leave the stakeholder dialogue in May 2013.&lt;br /&gt;
&lt;br /&gt;
2013年，欧盟委员会以“欧洲许可证”为题，推动了利益相关者对文本和数据挖掘的讨论。但他们将重点放在解决这一法律问题上，如许可证而不是限制和例外，导致大学、研究人员、图书馆、民间社会团体和开放获取出版商的代表于2013年5月离开了利益相关者对话。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===美国 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Copyright law of the United States|US copyright law]], and in particular its provision for [[fair use]], upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the [[Google Book Search Settlement Agreement|Google Book settlement]] the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&amp;lt;ref&amp;gt;{{cite web|title=Judge grants summary judgment in favor of Google Books — a fair use victory|url=http://www.lexology.com/library/detail.aspx?g=a18c5b92-5a20-4d1d-a098-a3095046a88e|website=Lexology.com|publisher=Antonelli Law Ltd|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
US copyright law, and in particular its provision for fair use, upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the Google Book settlement the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&lt;br /&gt;
&lt;br /&gt;
美国版权法，特别是其中关于合理使用的条款，支持在美国和其他合理使用国家，如以色列，台湾和韩国采矿内容的合法性。由于内容挖掘是变革性的，也就是说，它不会取代原来的工作，它被视为合法的合理使用。例如，作为谷歌图书和解协议的一部分，此案的主审法官裁定，谷歌版权图书数字化项目是合法的，部分原因在于数字化项目所展示的变革性用途——其中之一就是文本和数据挖掘。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】将“台湾和韩国采矿内容的合法性”改为“台湾和韩国内容挖掘的合法性”&lt;br /&gt;
&lt;br /&gt;
==软件 Software==&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Data mining and machine learning software}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===开源的数据挖掘软件 Free open-source data mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以使用免费 / 开源许可证。应用程序源代码也是对公众开放访问的。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Carrot2]]: Text and search results clustering framework.  文本和搜索结果聚类框架。&lt;br /&gt;
&lt;br /&gt;
* [[Chemicalize.org]]: A chemical structure miner and web search engine.  化学结构挖掘与网络搜索引擎。&lt;br /&gt;
&lt;br /&gt;
* [[ELKI]]: A university research project with advanced [[cluster analysis]] and [[anomaly detection|outlier detection]] methods written in the [[Java (programming language)|Java]] language.  一个大学研究项目，用Java语言编写高级聚类分析和离群点检测方法。&lt;br /&gt;
&lt;br /&gt;
* [[General Architecture for Text Engineering|GATE]]: a [[natural language processing]] and language engineering tool.  一个自然语言处理和语言工程工具。&lt;br /&gt;
&lt;br /&gt;
* [[KNIME]]: The Konstanz Information Miner, a user-friendly and comprehensive data analytics framework.  Konstanz Information Miner，一个用户友好的综合数据分析框架。&lt;br /&gt;
&lt;br /&gt;
* [[MOA (Massive Online Analysis)|Massive Online Analysis (MOA)]]: a real-time big data stream mining with concept drift tool in the [[Java (programming language)|Java]] programming language.  利用Java语言中的概念漂移工具进行实时大数据流挖掘。&lt;br /&gt;
&lt;br /&gt;
* [[Multi expression programming|MEPX]] - cross-platform tool for regression and classification problems based on a Genetic Programming variant.  基于遗传编程变量的回归和分类问题的跨平台工具。&lt;br /&gt;
&lt;br /&gt;
* ML-Flex: A software package that enables users to integrate with third-party machine-learning packages written in any programming language, execute classification analyses in parallel across multiple computing nodes, and produce HTML reports of classification results.  一种软件包，使用户能够与用任何编程语言编写的第三方机器学习包集成，跨多个计算节点并行执行分类分析，并生成分类结果的HTML报告。&lt;br /&gt;
&lt;br /&gt;
* [[mlpack]]: a collection of ready-to-use machine learning algorithms written in the [[C++]] language. 一个用C++语言编写的机器学习算法的集合。&lt;br /&gt;
&lt;br /&gt;
* [[NLTK]] ([[Natural Language Toolkit]]): A suite of libraries and programs for symbolic and statistical natural language processing (NLP) for the [[Python (programming language)|Python]] language.  一套用于Python语言的符号和统计自然语言处理（NLP）的库和程序。&lt;br /&gt;
&lt;br /&gt;
* [[OpenNN]]: Open [[neural networks]] library.  开源的神经网络库。&lt;br /&gt;
&lt;br /&gt;
* [[Orange (software)|Orange]]: A component-based data mining and [[machine learning]] software suite written in the [[Python (programming language)|Python]] language. 一个用Python语言编写的基于组件的数据挖掘和机器学习软件套件。&lt;br /&gt;
&lt;br /&gt;
* [[R (programming language)|R]]: A [[programming language]] and software environment for [[statistics|statistical]] computing, data mining, and graphics. It is part of the [[GNU Project]]. 一种用于统计计算、数据挖掘和图形的编程语言和软件环境。它是GNU项目的一部分。&lt;br /&gt;
&lt;br /&gt;
* [[scikit-learn]] is an open-source machine learning library for the Python programming language  是Python编程语言的一个开源机器学习库&lt;br /&gt;
&lt;br /&gt;
* [[Torch (machine learning)|Torch]]: An [[open source model|open-source]] [[deep learning]] library for the [[Lua (programming language)|Lua]] programming language and [[scientific computing]] framework with wide support for [[machine learning]] algorithms.  一个开源的深度学习lib库语言和科学计算框架，广泛支持机器学习算法。&lt;br /&gt;
&lt;br /&gt;
* [[UIMA]]: The UIMA (Unstructured Information Management Architecture) is a component framework for analyzing unstructured content such as text, audio and video – originally developed by IBM.  UIMA（非结构化信息管理体系结构）是一个用于分析非结构化内容（如文本、音频和视频）的组件框架，最初由IBM开发。&lt;br /&gt;
&lt;br /&gt;
* [[Weka (machine learning)|Weka]]: A suite of machine learning software applications written in the [[Java (programming language)|Java]] programming language.  用Java编程语言编写的一套机器学习软件应用程序。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===需要专有许可的数据挖掘软件和应用程序 Proprietary data-mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以根据专有许可证提供。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Angoss]] KnowledgeSTUDIO: data mining tool  数据挖掘工具。&lt;br /&gt;
&lt;br /&gt;
* [[LIONsolver]]: an integrated software application for data mining, business intelligence, and modeling that implements the Learning and Intelligent OptimizatioN (LION) approach.  用于数据挖掘、商业智能和建模的集成软件应用程序，实现学习和智能优化（LION）方法。&lt;br /&gt;
&lt;br /&gt;
* Megaputer Intelligence: data and text mining software is called PolyAnalyst.  数据和文本挖掘软件PolyAnalyst。&lt;br /&gt;
&lt;br /&gt;
* [[Microsoft Analysis Services]]: data mining software provided by [[Microsoft]].  微软提供的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[NetOwl]]: suite of multilingual text and entity analytics products that enable data mining.  支持数据挖掘的多语言文本和实体分析产品套件。&lt;br /&gt;
&lt;br /&gt;
* [[Oracle Data Mining]]: data mining software by [[Oracle Corporation]].  Oracle公司的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[PSeven]]: platform for automation of engineering simulation and analysis, multidisciplinary optimization and data mining provided by [[DATADVANCE]].  DATADVANCE为工程仿真分析、多学科优化和数据挖掘提供自动化平台。&lt;br /&gt;
&lt;br /&gt;
* [[Qlucore]] Omics Explorer: data mining software.  数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[RapidMiner]]: An environment for [[machine learning]] and data mining experiments. &amp;lt;!-- Latest version is NOT opensource --&amp;gt;  一个用于机器学习和数据挖掘实验的环境。&lt;br /&gt;
&lt;br /&gt;
* [[SAS (software)#Components|SAS Enterprise Miner]]: data mining software provided by the [[SAS Institute]].  SAS机构提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[SPSS Modeler]]: data mining software provided by [[IBM]].  IBM提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[STATISTICA]] Data Miner: data mining software provided by [[StatSoft]].  StatSoft提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[Tanagra (machine learning)|Tanagra]]: Visualisation-oriented data mining software, also for teaching.  面向可视化的数据挖掘软件，也用于教学。&lt;br /&gt;
&lt;br /&gt;
* [[Vertica]]: data mining software provided by [[Hewlett-Packard]].  惠普提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
==扩展链接 See also==&lt;br /&gt;
&lt;br /&gt;
; Methods&lt;br /&gt;
&lt;br /&gt;
方法&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Agent mining]]  主体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection|Anomaly/outlier/change detection]]  异常/异常/变化检测&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]]  关联规则学习&lt;br /&gt;
&lt;br /&gt;
* [[Bayesian network]]s  贝叶斯网络&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]]  分类&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis]]  聚类分析&lt;br /&gt;
&lt;br /&gt;
* [[Decision tree]]s  决策树&lt;br /&gt;
&lt;br /&gt;
* [[Ensemble learning]]  集成学习&lt;br /&gt;
&lt;br /&gt;
* [[Factor analysis]]  因子分析&lt;br /&gt;
&lt;br /&gt;
* [[Genetic algorithms]]  遗传算法&lt;br /&gt;
&lt;br /&gt;
* [[Intention mining]]  意向玩具&lt;br /&gt;
&lt;br /&gt;
* [[Learning classifier system]]  学习分类器系统&lt;br /&gt;
&lt;br /&gt;
* [[Multilinear subspace learning]]  多线性子空间学习&lt;br /&gt;
&lt;br /&gt;
* [[Artificial neural network|Neural network]]s  神经网络&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis]]  回归分析&lt;br /&gt;
&lt;br /&gt;
* [[Sequence mining]]   序列挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Structured data analysis (statistics)|Structured data analysis]]  结构数据学习&lt;br /&gt;
&lt;br /&gt;
* [[Support vector machines]]  支持向量机&lt;br /&gt;
&lt;br /&gt;
* [[Text mining]]  文本挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Time series|Time series analysis]]  时间序列分析&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application domains&lt;br /&gt;
&lt;br /&gt;
应用领域&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Analytics]] 分析&lt;br /&gt;
&lt;br /&gt;
* [[Behavior informatics]]  行为信息学&lt;br /&gt;
&lt;br /&gt;
* [[Big Data|Big data]]  大数据&lt;br /&gt;
&lt;br /&gt;
* [[Bioinformatics]]  生物信息学&lt;br /&gt;
&lt;br /&gt;
* [[Business intelligence]]  商务智能&lt;br /&gt;
&lt;br /&gt;
* [[Data analysis]]  数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Data warehouse]]  数据仓库&lt;br /&gt;
&lt;br /&gt;
* [[Decision support system]]  决策支持系统&lt;br /&gt;
&lt;br /&gt;
* [[Domain driven data mining]]  域驱动的数据挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Drug discovery]]  药物发现&lt;br /&gt;
&lt;br /&gt;
* [[Exploratory data analysis]]  探索性数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Predictive analytics]]  预测分析&lt;br /&gt;
&lt;br /&gt;
* [[Web mining]]  网页挖掘&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application examples&lt;br /&gt;
&lt;br /&gt;
应用示例&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|=&lt;br /&gt;
&lt;br /&gt;
*[[Automatic number plate recognition in the United Kingdom#Data mining|Automatic number plate recognition in the United Kingdom]]  英国的自动车牌识别&lt;br /&gt;
&lt;br /&gt;
*[[Customer analytics#Data mining|Customer analytics]]  客户分析&lt;br /&gt;
&lt;br /&gt;
*[[Educational data mining]]  教育数据挖掘&lt;br /&gt;
&lt;br /&gt;
*[[National Security Agency#Transaction data mining|National Security Agency]]  国家安全局&lt;br /&gt;
&lt;br /&gt;
*[[Quantitative structure–activity relationship#Data mining approach|Quantitative structure–activity relationship]]  数量结构-活动关系&lt;br /&gt;
&lt;br /&gt;
*[[Surveillance#Data mining and profiling|Surveillance]] / [[Mass surveillance#Data mining|Mass surveillance]] (e.g., [[Stellar Wind (code name)|Stellar Wind]])&lt;br /&gt;
监控/大规模监测（例如，恒星风）&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Related topics&lt;br /&gt;
&lt;br /&gt;
相关话题&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to ''analyzing'' data) , see:&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to analyzing data) , see:&lt;br /&gt;
&lt;br /&gt;
有关从数据中提取信息(与分析数据相反)的详细信息，请参阅:&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Data integration]]  数据集成&lt;br /&gt;
&lt;br /&gt;
* [[Data transformation]]  数据转换&lt;br /&gt;
&lt;br /&gt;
* [[Electronic discovery]]  电子发现&lt;br /&gt;
&lt;br /&gt;
* [[Information extraction]]  信息提取&lt;br /&gt;
&lt;br /&gt;
* [[Information integration]]  信息集成&lt;br /&gt;
&lt;br /&gt;
* [[Named-entity recognition]]  命名实体识别&lt;br /&gt;
&lt;br /&gt;
* [[Profiling (information science)]]  分析（信息科学）&lt;br /&gt;
&lt;br /&gt;
* [[Psychometrics]]  心理测量学&lt;br /&gt;
&lt;br /&gt;
* [[Social media mining]]  社交媒体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Surveillance capitalism]]  资本监视&lt;br /&gt;
&lt;br /&gt;
* [[Web scraping]]  网页抓取&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
;Other resources&lt;br /&gt;
&lt;br /&gt;
Other resources&lt;br /&gt;
&lt;br /&gt;
其他资源&lt;br /&gt;
&lt;br /&gt;
*[[International Journal of Data Warehousing and Mining]]  国际数据仓库与挖掘杂志&lt;br /&gt;
&lt;br /&gt;
==参考文献 References==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|30em}}&lt;br /&gt;
&lt;br /&gt;
==进一步阅读 Further reading==&lt;br /&gt;
&lt;br /&gt;
{{div col|colwidth=30em}}&lt;br /&gt;
&lt;br /&gt;
* Cabena, Peter; Hadjnian, Pablo; Stadler, Rolf; Verhees, Jaap; Zanasi, Alessandro (1997); ''Discovering Data Mining: From Concept to Implementation'', [[Prentice Hall]], {{ISBN|0-13-743980-6}}&lt;br /&gt;
&lt;br /&gt;
* M.S. Chen, J. Han, [[Philip S. Yu|P.S. Yu]] (1996) &amp;quot;[http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/chen_tkde96.pdf Data mining: an overview from a database perspective]&amp;quot;. ''Knowledge and data Engineering, IEEE Transactions'' on 8 (6), 866–883&lt;br /&gt;
&lt;br /&gt;
* Feldman, Ronen; Sanger, James (2007); ''The Text Mining Handbook'', [[Cambridge University Press]], {{ISBN|978-0-521-83657-9}}&lt;br /&gt;
&lt;br /&gt;
* Guo, Yike; and Grossman, Robert (editors) (1999); ''High Performance Data Mining: Scaling Algorithms, Applications and Systems'', [[Kluwer Academic Publishers]]&lt;br /&gt;
&lt;br /&gt;
* [[Jiawei Han|Han, Jiawei]], Micheline Kamber, and Jian Pei. ''Data mining: concepts and techniques''. Morgan kaufmann, 2006.&lt;br /&gt;
&lt;br /&gt;
* [[Trevor Hastie|Hastie, Trevor]], [[Robert Tibshirani|Tibshirani, Robert]] and [[Jerome H. Friedman|Friedman, Jerome]] (2001); ''The Elements of Statistical Learning: Data Mining, Inference, and Prediction'', Springer, {{ISBN|0-387-95284-5}}&lt;br /&gt;
&lt;br /&gt;
* [[Bing Liu (computer scientist)|Liu, Bing]] (2007, 2011); ''Web Data Mining: Exploring Hyperlinks, Contents and Usage Data'', [[Springer Verlag|Springer]], {{ISBN|3-540-37881-2}}&lt;br /&gt;
&lt;br /&gt;
* {{cite journal |last=Murphy |first=Chris |date=16 May 2011 |title=Is Data Mining Free Speech? |journal=[[InformationWeek]] |page=12 }}&lt;br /&gt;
&lt;br /&gt;
* Nisbet, Robert; Elder, John; Miner, Gary (2009); ''Handbook of Statistical Analysis &amp;amp; Data Mining Applications'', [[Academic Press]]/Elsevier, {{ISBN|978-0-12-374765-5}}&lt;br /&gt;
&lt;br /&gt;
* Poncelet, Pascal; Masseglia, Florent; and Teisseire, Maguelonne (editors) (October 2007); &amp;quot;Data Mining Patterns: New Methods and Applications&amp;quot;, ''Information Science Reference'', {{ISBN|978-1-59904-162-9}}&lt;br /&gt;
&lt;br /&gt;
* Tan, Pang-Ning; Steinbach, Michael; and Kumar, Vipin (2005); ''Introduction to Data Mining'', {{ISBN|0-321-32136-7}}&lt;br /&gt;
&lt;br /&gt;
* Theodoridis, Sergios; and Koutroumbas, Konstantinos (2009); ''Pattern Recognition'', 4th Edition, Academic Press, {{ISBN|978-1-59749-272-0}}&lt;br /&gt;
&lt;br /&gt;
* Weiss, Sholom M.; and Indurkhya, Nitin (1998); ''Predictive Data Mining'', [[Morgan Kaufmann]]&lt;br /&gt;
&lt;br /&gt;
* {{cite book |author1=Witten, Ian H.|authorlink1=Ian H. Witten |author2=Frank, Eibe |author3=Hall, Mark A. |title=Data Mining: Practical Machine Learning Tools and Techniques |edition=3 |date=30 January 2011 |publisher=Elsevier |isbn=978-0-12-374856-0 }} (See also [[Weka (machine learning)|Free Weka software]])&lt;br /&gt;
&lt;br /&gt;
* Ye, Nong (2003); ''The Handbook of Data Mining'', Mahwah, NJ: Lawrence Erlbaum&lt;br /&gt;
&lt;br /&gt;
{{div col end}}&lt;br /&gt;
&lt;br /&gt;
==相关链接External links==&lt;br /&gt;
&lt;br /&gt;
{{Commons category|Data mining}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Reference/Knowledge_Management/Knowledge_Discovery/Software|Knowledge Discovery Software}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Computers/Software/Databases/Data_Mining/Tool_Vendors|Data Mining Tool Vendors}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{data}}&lt;br /&gt;
&lt;br /&gt;
{{Data warehouse}}&lt;br /&gt;
&lt;br /&gt;
{{Computer science}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{Authority control}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{DEFAULTSORT:Data Mining}}&lt;br /&gt;
&lt;br /&gt;
[[Category:Data mining| ]]&lt;br /&gt;
&lt;br /&gt;
[[Category:Formal sciences]]&lt;br /&gt;
&lt;br /&gt;
Category:Formal sciences&lt;br /&gt;
&lt;br /&gt;
类别: 正规科学&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Data mining]]. Its edit history can be viewed at [[数据挖掘/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13900</id>
		<title>数据挖掘</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13900"/>
		<updated>2020-09-11T05:29:12Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条由许菁翻译整理。&lt;br /&gt;
&lt;br /&gt;
{{Machine learning bar}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Data mining''' is the process of discovering patterns in large [[data set]]s involving methods at the intersection of [[machine learning]], [[statistics]], and [[database system]]s.&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; Data mining is an [[interdisciplinary]] subfield of [[computer science]] and [[statistics]] with an overall goal to extract information (with intelligent methods) from a data set and transform the information into a comprehensible structure for further use.&amp;lt;ref name=&amp;quot;acm&amp;quot;&amp;gt;{{cite web |url=http://www.kdd.org/curriculum/index.html |title=Data Mining Curriculum |publisher=[[Association for Computing Machinery|ACM]] [[SIGKDD]] |date=2006-04-30 |accessdate=2014-01-27 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;brittanica&amp;quot;&amp;gt;{{cite web |last=Clifton |first=Christopher |title=Encyclopædia Britannica: Definition of Data Mining |year=2010 |url=http://www.britannica.com/EBchecked/topic/1056150/data-mining |accessdate=2010-12-09 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;elements&amp;quot;&amp;gt;{{cite web|last1=Hastie|first1=Trevor|authorlink1=Trevor Hastie|last2=Tibshirani|first2=Robert|authorlink2=Robert Tibshirani|last3=Friedman|first3=Jerome|authorlink3=Jerome H. Friedman|title=The Elements of Statistical Learning: Data Mining, Inference, and Prediction|year=2009|url=http://www-stat.stanford.edu/~tibs/ElemStatLearn/|accessdate=2012-08-07|archive-url=https://web.archive.org/web/20091110212529/http://www-stat.stanford.edu/~tibs/ElemStatLearn/|archive-date=2009-11-10|url-status=dead}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book|last1=Han, Kamber, Pei|first1=Jaiwei, Micheline, Jian|title=Data Mining: Concepts and Techniques|date=June 9, 2011|publisher=Morgan Kaufmann|isbn=978-0-12-381479-1|edition=3rd}}&amp;lt;/ref&amp;gt; Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt; Aside from the raw analysis step, it also involves database and [[data management]] aspects, [[data pre-processing]], [[statistical model|model]] and [[Statistical inference|inference]] considerations, interestingness metrics, [[Computational complexity theory|complexity]] considerations, post-processing of discovered structures, [[Data visualization|visualization]], and [[Online algorithm|online updating]].&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; &lt;br /&gt;
&lt;br /&gt;
Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD. Aside from the raw analysis step, it also involves database and data management aspects, data pre-processing, model and inference considerations, interestingness metrics, complexity considerations, post-processing of discovered structures, visualization, and online updating. &lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘 Data Mining &amp;lt;/font&amp;gt;'''是在大型数据集中发现模式的过程，是一种涉及到机器学习、统计学和数据库系统综合使用的方法。数据挖掘是指“在数据库中发现知识(knowledge discovery in databases,KDD)”过程中的分析步骤。除了传统的分析步骤，它还涉及数据库和数据管理方面，包括数据预处理、模型和推理考虑、兴趣度量、复杂性考虑、发现结构的后处理、可视化和在线更新等内容。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“数据挖掘是指“在数据库中知识发现KDD”的过程的分析步骤”一句中的“在数据库中知识发现KDD”处改为“在数据库中发现知识(knowledge discovery in databases,KDD)”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a [[misnomer]], because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (''mining'') of data itself.&amp;lt;ref name=&amp;quot;han-kamber&amp;quot;&amp;gt;{{cite book|title=Data mining: concepts and techniques|last1=Han|first1=Jiawei|last2=Kamber|first2=Micheline|date=2001|publisher=[[Morgan Kaufmann]]|isbn=978-1-55860-489-6|page=5|quote=Thus, data mining should have been more appropriately named &amp;quot;knowledge mining from data,&amp;quot; which is unfortunately somewhat long|authorlink1=Jiawei Han}}&amp;lt;/ref&amp;gt; It also is a [[buzzword]]&amp;lt;ref&amp;gt;[http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf OKAIRP 2005 Fall Conference, Arizona State University] {{Webarchive|url=https://web.archive.org/web/20140201170452/http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf|date=2014-02-01}}&amp;lt;/ref&amp;gt; and is frequently applied to any form of large-scale data or [[information processing]] ([[Data collection|collection]], [[information extraction|extraction]], [[Data warehouse|warehousing]], analysis, and statistics) as well as any application of [[Decision support system|computer decision support system]], including [[artificial intelligence]] (e.g., machine learning) and [[business intelligence]]. The book ''Data mining: Practical machine learning tools and techniques with Java''&amp;lt;ref name=&amp;quot;witten&amp;quot;&amp;gt;{{cite book|title=Data Mining: Practical Machine Learning Tools and Techniques|last1=Witten|first1=Ian H.|last2=Frank|first2=Eibe|last3=Hall|first3=Mark A.|date=30 January 2011|publisher=Elsevier|isbn=978-0-12-374856-0|edition=3|authorlink1=Ian H. Witten}}&amp;lt;/ref&amp;gt; (which covers mostly machine learning material) was originally to be named just ''Practical machine learning'', and the term ''data mining'' was only added for marketing reasons.&amp;lt;ref&amp;gt;{{Cite journal|author1=Bouckaert, Remco R.|author2=Frank, Eibe|author3=Hall, Mark A.|author4=Holmes, Geoffrey|author5=Pfahringer, Bernhard|author6=Reutemann, Peter|author7=Witten, Ian H.|authorlink7=Ian H. Witten|year=2010|title=WEKA Experiences with a Java open-source project|journal=Journal of Machine Learning Research|volume=11|pages=2533–2541|quote=the original title, &amp;quot;Practical machine learning&amp;quot;, was changed&amp;amp;nbsp;... The term &amp;quot;data mining&amp;quot; was [added] primarily for marketing reasons.|postscript={{inconsistent citations}}}}&amp;lt;/ref&amp;gt; Often the more general terms (''large scale'') ''[[data analysis]]'' and ''[[analytics]]'' – or, when referring to actual methods, ''artificial intelligence'' and ''machine learning'' – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a misnomer, because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (mining) of data itself. It also is a buzzword and is frequently applied to any form of large-scale data or information processing (collection, extraction, warehousing, analysis, and statistics) as well as any application of computer decision support system, including artificial intelligence (e.g., machine learning) and business intelligence. The book Data mining: Practical machine learning tools and techniques with Java (which covers mostly machine learning material) was originally to be named just Practical machine learning, and the term data mining was only added for marketing reasons. Often the more general terms (large scale) data analysis and analytics – or, when referring to actual methods, artificial intelligence and machine learning – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
“数据挖掘”这种形容其实并不十分恰当，因为我们的目标是从大量数据中提取模式和知识，而不是数据本身的提取(挖掘)。它是一个流行语，经常用于任何形式的大规模数据或信息处理（收集、提取、仓储、分析和统计）的场景下，以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 计算机决策系统 Decision Support System，DSS&amp;lt;/font&amp;gt;'''的任何应用当中，包括人工智能（例如机器学习）和商业智能。《数据挖掘：使用Java的实用机器学习工具和技术》（主要涵盖机器学习材料）一书最初被命名为“实用机器学习”，而数据挖掘一词只是为了营销的原因而增加。经常来说，更一般的术语如（大规模）数据分析，或实际的方法如人工智能和机器学习，是更合适的表达方式。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适”一句改为“经常来说，更一般的术语如（大规模）数据分析，或实际的方法如人工智能和机器学习，是更合适的表达方式”&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records ([[cluster analysis]]), unusual records ([[anomaly detection]]), and dependencies ([[association rule mining]], [[sequential pattern mining]]). This usually involves using database techniques such as [[spatial index|spatial indices]]. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and [[predictive analytics]]. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a [[decision support system]]. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records (cluster analysis), unusual records (anomaly detection), and dependencies (association rule mining, sequential pattern mining). This usually involves using database techniques such as spatial indices. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and predictive analytics. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a decision support system. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
实际上数据挖掘任务是对大量数据进行半自动或全自动分析，以提取出从前未知的且有趣的模式，如数据记录组(数据聚类)、异常记录组(异常检测)和依赖关系(关联规则挖掘，序列挖掘)。这通常涉及使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种汇总，并且可以用于进一步的分析，或者，例如，机器学习和预测分析。例如，数据挖掘步骤可以识别数据中的多个组，然后可以使用该步骤通过决策支持系统获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是作为附加步骤属于整个 KDD 过程。&lt;br /&gt;
&lt;br /&gt;
如数据记录组（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''）、异常记录（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly Detection&amp;lt;/font&amp;gt;'''）和依赖关系（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则挖掘 Association Rule Mining&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;序列模式挖掘 Sequential Pattern Mining&amp;lt;/font&amp;gt;'''）。这通常涉及到使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种规律总结，可以用于进一步的分析，或者，例如，在机器学习和预测分析中。例如，通过数据挖掘可以出识别数据中的多个组，然后这些组可以通过使用决策支持系统来获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是属于整个KDD过程的附加步骤。&lt;br /&gt;
&lt;br /&gt;
The difference between [[data analysis]] and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&amp;lt;ref&amp;gt;Olson, D. L. (2007). Data mining in business services. ''Service Business'', ''1''(3), 181-193. {{doi|10.1007/s11628-006-0014-7}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The difference between data analysis and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据分析 Data Analysis&amp;lt;/font&amp;gt;'''和数据挖掘的区别在于，数据分析用于测试数据集上的模型和假设，例如，分析营销活动的有效性，而不考虑数据量的多少；相反，数据挖掘使用机器学习和统计模型来发现“大量”数据中的秘密或隐藏模式。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The related terms ''[[data dredging]]'', ''data fishing'', and ''data snooping'' refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
The related terms data dredging, data fishing, and data snooping refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
相关术语'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;“数据疏浚” Data Dredging&amp;lt;/font&amp;gt;'''、“数据钓鱼”和“数据窥探”是指使用数据挖掘方法对较大的人口数据集中的一部分进行抽样，这些数据集太小（或可能太小），无法对所发现的任何模式的有效性作出可靠的统计推断。但是，这些方法可以用于提出新的假设，以针对更大的数据群体进行测试。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==起源 Etymology==&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like ''data fishing'' or ''data dredging'' to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist [[Michael Lovell]] in an article published in the ''[[Review of Economic Studies]]'' in 1983.&amp;lt;ref&amp;gt;{{Cite journal|last=Lovell|first=Michael C.|date=1983|title=Data Mining|journal=The Review of Economics and Statistics|volume=65|issue=1|pages=1–12|doi=10.2307/1924403|jstor=1924403}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book |first=Wojciech W. |last=Charemza |first2=Derek F. |last2=Deadman |title=New Directions in Econometric Practice |location=Aldershot |publisher=Edward Elgar |year=1992 |chapter=Data Mining |pages=14–31 |isbn=1-85278-461-X }}&amp;lt;/ref&amp;gt; Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like data fishing or data dredging to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist Michael Lovell in an article published in the Review of Economic Studies in 1983. Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
在20世纪60年代，统计学家和经济学家们曾经使用“数据钓鱼”或”数据疏浚“等术语来指代他们认为在没有先验假设的情况下进行数据分析的糟糕做法。经济学家迈克尔•洛弗尔 Michael Lovell 在1983年《经济研究评论》（Review of Economic Studies）上发表的一篇文章中，也以类似的批判方式使用了“数据挖掘”这个术语。Lovell 指出，这种做法“伪装成各种别名，从“实验”(正面)到“钓鱼”或“窥探”(负面)。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term ''data mining'' appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation;&amp;lt;ref name=&amp;quot;Mena&amp;quot;&amp;gt;{{cite book |last=Mena |first=Jesús |year=2011 |title=Machine Learning Forensics for Law Enforcement, Security, and Intelligence |location=Boca Raton, FL |publisher=CRC Press (Taylor &amp;amp; Francis Group) |isbn=978-1-4398-6069-4 }}&amp;lt;/ref&amp;gt; researchers consequently turned to ''data mining''. Other terms used include ''data archaeology'', ''information harvesting'', ''information discovery'', ''knowledge extraction'', etc. [[Gregory I. Piatetsky-Shapiro|Gregory Piatetsky-Shapiro]] coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic [http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] and this term became more popular in [[Artificial intelligence|AI]] and [[machine learning]] community. However, the term data mining became more popular in the business and press communities.&amp;lt;ref&amp;gt;{{cite web |last1=Piatetsky-Shapiro |first1=Gregory |authorlink1=Gregory Piatetsky-Shapiro |last2=Parker |first2=Gary |url=http://www.kdnuggets.com/data_mining_course/x1-intro-to-data-mining-notes.html |title=Lesson: Data Mining, and Knowledge Discovery: An Introduction |publisher=KD Nuggets |year=2011 |work=Introduction to Data Mining |accessdate=30 August 2012 }}&amp;lt;/ref&amp;gt; Currently, the terms ''data mining'' and ''knowledge discovery'' are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
The term data mining appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation; researchers consequently turned to data mining. Other terms used include data archaeology, information harvesting, information discovery, knowledge extraction, etc. Gregory Piatetsky-Shapiro coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic (KDD-1989) and this term became more popular in AI and machine learning community. However, the term data mining became more popular in the business and press communities. Currently, the terms data mining and knowledge discovery are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
数据挖掘这个术语在1990年左右出现在数据库领域，通常有着积极的内涵。在20世纪80年代的一段短暂时间里，人们曾使用过“数据库挖掘”这种表达，但由于这个词被总部位于圣地亚哥的 HNC 公司注册为商标，因此研究人员转向了数据挖掘。曾用过的其他术语包括数据考古学、信息收集、信息发现、知识提取等。格雷戈里·皮亚特斯基·夏皮罗 Gregory Piatetsky-Shapiro 在关于这个主题的第一个研讨会[ http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] 上首次创造了“数据库中的知识发现 Knowledge Discovery in Databases，KDD”这个术语。此后，这个术语在人工智能和机器学习社区中变得更加流行。然而，数据挖掘这个术语在商业和出版界变得越来越流行。目前，数据挖掘和知识发现 knowledge discovery这两个术语可以互换使用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery ([[KDD-95]]) was started in Montreal under [[AAAI]] sponsorship. It was co-chaired by [[Usama Fayyad]] and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called [[Data Mining and Knowledge Discovery]] as its founding editor-in-chief. Later he started the [[SIGKDD]] Newsletter SIGKDD Explorations.&amp;lt;ref name=SIGKDD-explorations&amp;gt;{{cite journal|last1=Fayyad|first1=Usama|title=First Editorial by Editor-in-Chief|journal=SIGKDD Explorations|date=15 June 1999|volume=13|issue=1|pages=102|doi=10.1145/2207243.2207269|url=http://www.kdd.org/explorations/view/june-1999-volume-1-issue-1|accessdate=27 December 2010|ref=SIGKDD-explorations}}&amp;lt;/ref&amp;gt; The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal ''Data Mining and Knowledge Discovery'' is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery (KDD-95) was started in Montreal under AAAI sponsorship. It was co-chaired by Usama Fayyad and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called Data Mining and Knowledge Discovery as its founding editor-in-chief. Later he started the SIGKDD Newsletter SIGKDD Explorations.The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal Data Mining and Knowledge Discovery is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
在学术界，主要的研究论坛始于1995年，当时，在AAAI的赞助下，第一届数据挖掘和知识发现国际会议（KDD-95）在蒙特利尔召开。会议由乌萨马·法耶兹 Usama Fayyad和拉玛萨米·乌图鲁萨米 Ramasamy Uthurusamy共同主持。一年后，1996年Usama Fayyad创办了杂志《数据挖掘与知识发现》（datamining and Knowledge Discovery），担任创始主编。后来他创办了SIGKDD时事通讯探索。那个KDD国际会议也成为了数据挖掘领域质量最高的主要会议，其研究论文提交的接受率低于18%，而《数据挖掘与知识发现》也成为了该领域的主要研究期刊。&lt;br /&gt;
&lt;br /&gt;
==背景 Background==&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from [[data]] has occurred for centuries. Early methods of identifying patterns in data include [[Bayes' theorem]] (1700s) and [[regression analysis]] (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As [[data set]]s have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as [[neural networks]], [[cluster analysis]], [[genetic algorithms]] (1950s), [[decision tree learning|decision trees]] and [[decision rules]] (1960s), and [[support vector machines]] (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns&amp;lt;ref name=&amp;quot;Kantardzic&amp;quot;&amp;gt;{{cite book |last=Kantardzic |first=Mehmed |title=Data Mining: Concepts, Models, Methods, and Algorithms |year=2003 |publisher=John Wiley &amp;amp; Sons |isbn=978-0-471-22852-3 |oclc=50055336 |url-access=registration |url=https://archive.org/details/dataminingconcep0000kant }}&amp;lt;/ref&amp;gt; in large data sets. It bridges the gap from [[applied statistics]] and artificial intelligence (which usually provide the mathematical background) to [[database management]] by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from data has occurred for centuries. Early methods of identifying patterns in data include Bayes' theorem (1700s) and regression analysis (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As data sets have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as neural networks, cluster analysis, genetic algorithms (1950s), decision trees and decision rules (1960s), and support vector machines (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns in large data sets. It bridges the gap from applied statistics and artificial intelligence (which usually provide the mathematical background) to database management by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
从数据中手动提取模式的方法已经持续了好几个世纪了。早期识别数据模式的方法包括17世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;贝叶斯定理 Bayes' Theorem&amp;lt;/font&amp;gt;'''和19世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归分析 Regression Analysis&amp;lt;/font&amp;gt;'''。计算机技术的扩散、其普遍性和日益强大的能力极大地提高了数据的收集、存储和操作能力。随着数据集的规模和复杂性的增长，手动分析数据的方法越来越多地被更强的间接、自动化的数据处理所取代，这都得益于计算机科学其他领域取得的新的进步，特别是机器学习领域的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;神经网络 Neural Networks&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;遗传算法 Genetic Algorithms&amp;lt;/font&amp;gt;'''（1950年代），'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策树 Decision Tree&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策规则 Decision Rules&amp;lt;/font&amp;gt;'''（1960年代）以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;支持向量机 Support Vector Machines&amp;lt;/font&amp;gt;'''（1990年代）等。数据挖掘就是应用这些方法来发现大型数据集中的隐藏模式的过程。它利用数据在数据库中存储和索引的方式，更有效地执行实际的学习和发现算法，从而弥补了从应用统计学和人工智能(通常提供数学背景)到数据库管理之间的差距，使这些方法能够应用于更大的数据集。&lt;br /&gt;
&lt;br /&gt;
==发展过程 Process==&lt;br /&gt;
&lt;br /&gt;
The ''knowledge discovery in databases (KDD) process'' is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
The knowledge discovery in databases (KDD) process is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
数据库中的知识发现 Knowledge Discovery in Databases ，KDD过程通常定义为以下几个阶段:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Selection&lt;br /&gt;
&lt;br /&gt;
 Selection&lt;br /&gt;
&lt;br /&gt;
选择&lt;br /&gt;
&lt;br /&gt;
# Pre-processing&lt;br /&gt;
&lt;br /&gt;
 Pre-processing&lt;br /&gt;
&lt;br /&gt;
预处理&lt;br /&gt;
&lt;br /&gt;
# Transformation&lt;br /&gt;
&lt;br /&gt;
 Transformation&lt;br /&gt;
&lt;br /&gt;
转换&lt;br /&gt;
&lt;br /&gt;
# ''Data mining''&lt;br /&gt;
&lt;br /&gt;
 Data mining&lt;br /&gt;
&lt;br /&gt;
数据挖掘&lt;br /&gt;
&lt;br /&gt;
# Interpretation/evaluation.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
 Interpretation/evaluation.&lt;br /&gt;
&lt;br /&gt;
解释 / 评估。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the [[Cross-industry standard process for data mining]] (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the Cross-industry standard process for data mining (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
然而，它存在于这个主题的许多变体中，例如在'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘的跨行业标准流程 Cross-industry standard process for data mining，CRISP-DM&amp;lt;/font&amp;gt;'''中它定义了以下六个阶段：&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Business understanding&lt;br /&gt;
&lt;br /&gt;
 Business understanding&lt;br /&gt;
&lt;br /&gt;
商业理解&lt;br /&gt;
&lt;br /&gt;
# Data understanding&lt;br /&gt;
&lt;br /&gt;
 Data understanding&lt;br /&gt;
&lt;br /&gt;
数据理解&lt;br /&gt;
&lt;br /&gt;
# Data preparation&lt;br /&gt;
&lt;br /&gt;
 Data preparation&lt;br /&gt;
&lt;br /&gt;
数据准备&lt;br /&gt;
&lt;br /&gt;
# Modeling&lt;br /&gt;
&lt;br /&gt;
 Modeling&lt;br /&gt;
&lt;br /&gt;
建模&lt;br /&gt;
&lt;br /&gt;
# Evaluation&lt;br /&gt;
&lt;br /&gt;
 Evaluation&lt;br /&gt;
&lt;br /&gt;
评估&lt;br /&gt;
&lt;br /&gt;
# Deployment&lt;br /&gt;
&lt;br /&gt;
 Deployment&lt;br /&gt;
&lt;br /&gt;
部署&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
或一个简化的过程，包括：(1)预处理，(2)数据挖掘，(3)结果验证。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners.&amp;lt;ref&amp;gt;[[Gregory Piatetsky-Shapiro]] (2002) [http://www.kdnuggets.com/polls/2002/methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2004) [http://www.kdnuggets.com/polls/2004/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2007) [http://www.kdnuggets.com/polls/2007/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2014) [http://www.kdnuggets.com/polls/2014/analytics-data-mining-data-science-methodology.html ''KDnuggets Methodology Poll'']&amp;lt;/ref&amp;gt; The only other data mining standard named in these polls was [[SEMMA]]. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models,&amp;lt;ref name=&amp;quot;kurgan&amp;quot;&amp;gt;Lukasz Kurgan and Petr Musilek (2006); [http://journals.cambridge.org/action/displayAbstract?fromPage=online&amp;amp;aid=451120 ''A survey of Knowledge Discovery and Data Mining process models'']. The Knowledge Engineering Review. Volume 21 Issue 1, March 2006, pp&amp;amp;nbsp;1–24, Cambridge University Press, New York, NY, USA {{DOI|10.1017/S0269888906000737}}&amp;lt;/ref&amp;gt; and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&amp;lt;ref name=&amp;quot;AzevedoSantos&amp;quot;&amp;gt;Azevedo, A. and Santos, M. F. [http://www.iadis.net/dl/final_uploads/200812P033.pdf KDD, SEMMA and CRISP-DM: a parallel overview] {{webarchive|url=https://web.archive.org/web/20130109114939/http://www.iadis.net/dl/final_uploads/200812P033.pdf |date=2013-01-09 }}. In Proceedings of the IADIS European Conference on Data Mining 2008, pp&amp;amp;nbsp;182–185.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners. The only other data mining standard named in these polls was SEMMA. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models, and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&lt;br /&gt;
&lt;br /&gt;
在这些调查中，唯一的其他数据挖掘标准是SEMMA。然而，使用CRISP-DM的人数是其3-4倍。一些研究小组已经发表了关于数据挖掘过程模型的研究，例如阿泽维多 Azevedo和 桑托斯Santos曾在2008年对CRISP-DM和SEMMA这两套数据挖掘流程标准进行了比较。&lt;br /&gt;
&lt;br /&gt;
===预处理 Pre-processing===&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a [[data mart]] or [[data warehouse]]. Pre-processing is essential to analyze the [[Multivariate statistics|multivariate]] data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing [[statistical noise|noise]] and those with [[missing data]].&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a data mart or data warehouse. Pre-processing is essential to analyze the multivariate data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing noise and those with missing data.&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须先对目标数据集进行整合。由于数据挖掘只能发现数据中实际存在的模式，目标数据集必须足够大以包含这些模式，同时保持足够简洁以便在可接受的时间限制内进行挖掘。数据的公共源是数据集市或数据仓库。在数据挖掘之前，对多变量数据集进行预处理是必不可少的。然后清理目标集。数据清理去除了包含噪声的观测值和缺失数据的观测值。&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须组装目标数据集。由于数据挖掘只能发现数据中实际存在的模式，因此目标数据集必须足够大以包含这些模式，同时保持足够简洁，以便在可接受的时间限制内进行挖掘。数据的常见来源是'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据集市 Data Mart&amp;lt;/font&amp;gt;'''或'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据仓库 Data Warehouse&amp;lt;/font&amp;gt;'''。在数据挖掘之前，对'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;多元 Multivariate&amp;lt;/font&amp;gt;'''数据集进行预处理是必不可少的，然后对目标集进行清洗。数据清洗将删除包含'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;噪声 Noise&amp;lt;/font&amp;gt;'''的观测值和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;缺失数据 Missing Data&amp;lt;/font&amp;gt;'''的观测值。&lt;br /&gt;
&lt;br /&gt;
===数据挖掘 Data mining===&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&amp;lt;ref name=&amp;quot;Fayyad&amp;quot;&amp;gt;{{cite web |last1=Fayyad |first1=Usama |authorlink1=Usama Fayyad |last2=Piatetsky-Shapiro |first2=Gregory|authorlink2=Gregory Piatetsky-Shapiro |last3=Smyth |first3=Padhraic |title=From Data Mining to Knowledge Discovery in Databases |year=1996 |url=http://www.kdnuggets.com/gpspubs/aimag-kdd-overview-1996-Fayyad.pdf |accessdate = 17 December 2008 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&lt;br /&gt;
&lt;br /&gt;
数据挖掘涉及六类常见的任务:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection]] (outlier/change/deviation detection) – The identification of unusual data records, that might be interesting or data errors that require further investigation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly detection&amp;lt;/font&amp;gt;'''（异常值/变化/偏差检测）：识别异常数据记录，发现可能是有趣的或需要进一步调查的数据错误。&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]] (dependency modeling) – Searches for relationships between variables. For example, a supermarket might gather data on customer purchasing habits. Using association rule learning, the supermarket can determine which products are frequently bought together and use this information for marketing purposes. This is sometimes referred to as market basket analysis.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则学习 Association rule learning&amp;lt;/font&amp;gt;'''（依赖关系建模）：探变量之间的关系。例如，超市可能会收集顾客购买习惯的数据。通过使用关联规则学习，超市可以确定哪些产品经常被一起购买，并将这些信息用于营销策略改进。这种研究有时被称为“市场篮子分析”。&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis|Clustering]] – is the task of discovering groups and structures in the data that are in some way or another &amp;quot;similar&amp;quot;, without using known structures in the data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类 Clustering&amp;lt;/font&amp;gt;'''：是指在数据中发现以某种方式或其他方式“相似”的组和结构，而不使用数据中已知的结构。&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]] – is the task of generalizing known structure to apply to new data. For example, an e-mail program might attempt to classify an e-mail as &amp;quot;legitimate&amp;quot; or as &amp;quot;spam&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;分类 Classification&amp;lt;/font&amp;gt;'''：是将已知结构归纳为新数据的任务。例如，电子邮件程序可能会尝试将电子邮件分类为“合法”或“垃圾邮件”。&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis|Regression]] – attempts to find a function that models the data with the least error that is, for estimating the relationships among data or datasets.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归&amp;lt;/font&amp;gt;'''：试图找到一个对数据建模误差最小的函数，也就是说，用于估计数据或数据集之间的关系。&lt;br /&gt;
&lt;br /&gt;
* [[Automatic summarization|Summarization]] – providing a more compact representation of the data set, including visualization and report generation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;自动文摘 Automatic summarizatio&amp;lt;/font&amp;gt;'''：提供数据集更紧凑、简洁的表示，包括可视化和报告生成。&lt;br /&gt;
&lt;br /&gt;
===结果验证 Results validation===&lt;br /&gt;
&lt;br /&gt;
[[File:Spurious correlations - spelling bee spiders.svg|thumb|An example of data produced by [[data dredging]] through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence. 一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。]]&lt;br /&gt;
&lt;br /&gt;
An example of data produced by data dredging through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence.&lt;br /&gt;
&lt;br /&gt;
一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be [[Reproducibility|reproduced]] on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper [[statistical hypothesis testing]]. A simple version of this problem in [[machine learning]] is known as [[overfitting]], but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&amp;lt;ref name=hawkins&amp;gt;{{cite journal | last1 = Hawkins | first1 = Douglas M | year = 2004 | title = The problem of overfitting | url = | journal = Journal of Chemical Information and Computer Sciences | volume = 44 | issue = 1| pages = 1–12 | doi=10.1021/ci0342472| pmid = 14741005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be reproduced on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper statistical hypothesis testing. A simple version of this problem in machine learning is known as overfitting, but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&lt;br /&gt;
&lt;br /&gt;
数据挖掘可能会在无意中被误用，然后产生看似重要的结果; 但这些结果实际上并不能用来预测未来的行为，也不能在新的数据样本上进行复现，而且用处不大。这通常是由于调查了太多的假设，而没有进行适当的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;统计假设检验 Statistical Hypothesis Testing&amp;lt;/font&amp;gt;'''。在机器学习中，这种问题可以被简称为'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''，但相同的问题可能会在过程的不同阶段出现，因此，在完全适用的情况下，合理进行训练/测试分割这一种方法可能不足以防止这种情况的发生。&lt;br /&gt;
&lt;br /&gt;
{{Missing information|section|non-classification tasks in data mining. It only covers [[machine learning]]|date=September 2011}}&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called [[overfitting]]. To overcome this, the evaluation uses a [[test set]] of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a [[training set]] of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had ''not'' been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as [[Receiver operating characteristic|ROC curves]].&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called overfitting. To overcome this, the evaluation uses a test set of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a training set of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had not been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as ROC curves.&lt;br /&gt;
&lt;br /&gt;
从数据中发现知识的最后一步是验证数据挖掘算法产生的模式是否存在于更广泛的数据集中。数据挖掘算法发现的并非所有模式都是有效的，因为对于数据挖掘算法来说，在训练集中发现一般数据集中没有的模式是很常见的，这叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''。为了克服这个问题，评估使用一组测试数据，而数据挖掘算法并没有在这些测试数据上进行训练。然后将学习到的模式应用到这个'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;测试集 Test Set&amp;lt;/font&amp;gt;'''中，并将结果输出与期望的输出进行比较。例如，试图区分“垃圾邮件”和“合法”邮件的数据挖掘算法将根据一组电子邮件'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;训练集 Training Sett&amp;lt;/font&amp;gt;'''样本进行训练。训练完毕后，学到的模式将应用于未经训练的那部分电子邮件测试集数据上。然后，可以从这些模式正确分类的电子邮件数量来衡量这些模式的准确性。可以使用几种统计方法可以用来评估算法，如'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;ROC 曲线 ROC curves&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
如果学习的模式不能达到预期的标准，那么就需要重新评估和修改预处理和数据挖掘的步骤。如果所学的模式确实符合所需的标准，那么最后一步就是对习得的模式进行解释并将其转化为知识。&lt;br /&gt;
&lt;br /&gt;
==研究 Research==&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the [[Association for Computing Machinery]]'s (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining ([[SIGKDD]]).&amp;lt;ref&amp;gt;{{cite web|url=http://academic.research.microsoft.com/?SearchDomain=2&amp;amp;SubDomain=7&amp;amp;entitytype=2|title=Microsoft Academic Search: Top conferences in data mining | publisher=[[Microsoft Academic Search]]}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|url=https://scholar.google.de/citations?view_op=top_venues&amp;amp;hl=en&amp;amp;vq=eng_datamininganalysis|title=Google Scholar: Top publications - Data Mining &amp;amp; Analysis|publisher=[[Google Scholar]]}}&amp;lt;/ref&amp;gt; Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings,&amp;lt;ref&amp;gt;[http://www.kdd.org/conferences.php Proceedings] {{Webarchive|url=https://web.archive.org/web/20100430120252/http://www.kdd.org/conferences.php |date=2010-04-30 }}, International Conferences on Knowledge Discovery and Data Mining, ACM, New York.&amp;lt;/ref&amp;gt; and since 1999 it has published a biannual [[academic journal]] titled &amp;quot;SIGKDD Explorations&amp;quot;.&amp;lt;ref&amp;gt;[http://www.kdd.org/explorations/about.php SIGKDD Explorations], ACM, New York.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the Association for Computing Machinery's (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining (SIGKDD). Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings, and since 1999 it has published a biannual academic journal titled &amp;quot;SIGKDD Explorations&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
该领域的首要专业机构是计算机协会 ACM的知识发现和数据挖掘特别兴趣小组 SIGKDD。自1989年以来，ACM SIG每年举办一次国际会议并出版会议记录，自1999年起，它还出版了一份名为“SIGKDD探索”的两年期学术期刊。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
关于数据挖掘的计算机科学会议包括:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[CIKM Conference]] – ACM [[Conference on Information and Knowledge Management]]&lt;br /&gt;
&lt;br /&gt;
CIKM会议 ：ACM'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;信息和知识管理会议 Conference on Information and Knowledge Management&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
* [[European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases]]&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;欧洲机器学习与数据库知识发现原理与实践会议 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
* [[KDD Conference]] – ACM SIGKDD [[Conference on Knowledge Discovery and Data Mining]]&lt;br /&gt;
&lt;br /&gt;
KDD会议：ACM SIGKDD的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;知识发现与数据挖掘会议 Conference on Knowledge Discovery and Data Mining&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many [[List of computer science conferences#Data Management|data management/database conferences]] such as the ICDE Conference, [[SIGMOD|SIGMOD Conference]] and [[International Conference on Very Large Data Bases]]&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many data management/database conferences such as the ICDE Conference, SIGMOD Conference and International Conference on Very Large Data Bases.&lt;br /&gt;
&lt;br /&gt;
数据挖掘专题也出现在许多数据管理/数据库会议上，如 ICDE会议、 '''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;SIGMOD会议 SIGMOD Conference&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关于超大数据库国际会议International Conference on Very Large Data Bases&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
==标准 Standards==&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European [[Cross Industry Standard Process for Data Mining]] (CRISP-DM 1.0) and the 2004 [[Java Data Mining]] standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European Cross Industry Standard Process for Data Mining (CRISP-DM 1.0) and the 2004 Java Data Mining standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
为数据挖掘过程定义了一些标准，例如1999年欧洲跨行业数据挖掘标准流程（CRISP-DM 1.0）和2004年Java数据挖掘标准（JDM 1.0）。这些程序的后续程序（CRISP-DM 2.0和 JDM 2.0）的开发活跃于2006年，但此后一直停滞不前。Jdm 2.0没有达成最终草案就被撤销了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in [[predictive analytics]]&amp;amp;nbsp;– the key standard is the [[Predictive Model Markup Language]] (PMML), which is an [[XML]]-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) [[subspace clustering]] have been proposed independently of the DMG.&amp;lt;ref&amp;gt;{{Cite book | last1 = Günnemann | first1 = Stephan | last2 = Kremer | first2 = Hardy | last3 = Seidl | first3 = Thomas | doi = 10.1145/2023598.2023605 | chapter = An extension of the PMML standard to subspace clustering models | title = Proceedings of the 2011 workshop on Predictive markup language modeling - PMML '11 | pages = 48 | year = 2011 | isbn = 978-1-4503-0837-3 | pmid =  | pmc = }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in predictive analytics&amp;amp;nbsp;– the key standard is the Predictive Model Markup Language (PMML), which is an XML-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) subspace clustering have been proposed independently of the DMG.&lt;br /&gt;
&lt;br /&gt;
为了交换所提取的模型，特别是在预测分析中使用，关键的标准是预测模型标记语言 PMML，这是一种基于 XML 的语言，由数据挖掘集团 DMG 开发，并支持作为交换格式的许多数据挖掘应用程序。顾名思义，它只涵盖预测模型，这是一项对业务应用程序非常重要的特殊数据挖掘任务。然而，覆盖子空间聚类的扩展已经独立于 DMG 被提出。&lt;br /&gt;
&lt;br /&gt;
==显著用途 Notable uses==&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable [[examples of data mining]] can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable examples of data mining can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
数据挖掘在任何有数字数据可用的地方都可以被使用。数据挖掘的著名例子可以在商业、医学、科学和监控领域找到。&lt;br /&gt;
&lt;br /&gt;
==隐私问题和道德规范 Privacy concerns and ethics==&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&amp;lt;ref&amp;gt;{{cite journal |author=Seltzer, William |title=The Promise and Pitfalls of Data Mining: Ethical Issues |url=https://ww2.amstat.org/committees/ethics/linksdir/Jsm2005Seltzer.pdf|publisher = American Statistical Association|journal = ASA Section on Government Statistics|date = 2005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&lt;br /&gt;
&lt;br /&gt;
虽然“数据挖掘”这个术语本身可能没有伦理含义，但它通常与人们行为（伦理和其他）相关的信息挖掘有关。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding [[privacy]], legality, and ethics.&amp;lt;ref&amp;gt;{{cite journal |author=Pitts, Chip |title=The End of Illegal Domestic Spying? Don't Count on It |url=http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |journal=Washington Spectator |date=15 March 2007 |url-status=dead |archiveurl=https://web.archive.org/web/20071128015201/http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |archivedate=2007-11-28 }}&amp;lt;/ref&amp;gt; In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the [[Total Information Awareness]] Program or in [[ADVISE]], has raised privacy concerns.&amp;lt;ref&amp;gt;{{cite journal |author=Taipale, Kim A. |title=Data Mining and Domestic Security: Connecting the Dots to Make Sense of Data |url=http://www.stlr.org/cite.cgi?volume=5&amp;amp;article=2 |journal=Columbia Science and Technology Law Review |volume=5 |issue=2 |date=15 December 2003 |ssrn=546782 |oclc=45263753 }}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|last1=Resig|first1=John|title=A Framework for Mining Instant Messaging Services|url=https://johnresig.com/files/research/SIAMPaper.pdf|accessdate=16 March 2018}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding privacy, legality, and ethics. In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the Total Information Awareness Program or in ADVISE, has raised privacy concerns.&lt;br /&gt;
&lt;br /&gt;
在某些情况下，数据挖掘的使用方式可能会引发隐私、合法性和伦理问题。特别是，为国家安全或执法目的而进行的政府或商业数据集的数据挖掘，如在全面信息意识项目或在 ADVISE 中，引起了隐私问题。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through [[aggregate function|data aggregation]]. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent).&amp;lt;ref name=&amp;quot;NASCIO&amp;quot;&amp;gt;[http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf ''Think Before You Dig: Privacy Implications of Data Mining &amp;amp; Aggregation''] {{webarchive|url=https://web.archive.org/web/20081217063043/http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf |date=2008-12-17 }}, NASCIO Research Brief, September 2004&amp;lt;/ref&amp;gt; This is not data mining ''per se'', but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&amp;lt;ref&amp;gt;{{cite magazine |first=Paul |last=Ohm |title=Don't Build a Database of Ruin |magazine=Harvard Business Review |url=http://blogs.hbr.org/cs/2012/08/dont_build_a_database_of_ruin.html}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/12/03/iron-cagebook/ Iron Cagebook - The Logical End of Facebook's Patents], [[Counterpunch.org]], 2013.12.03&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/09/11/inside-the-tech-industrys-startup-conference/ Inside the Tech industry's Startup Conference], [[Counterpunch.org]], 2013.09.11&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through data aggregation. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent). This is not data mining per se, but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&lt;br /&gt;
&lt;br /&gt;
数据挖掘需要进行数据准备，以发现损害机密性和隐私义务的信息或模式。实现这一点的一种常见方式是通过'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据聚合 Data Aggregation&amp;lt;/font&amp;gt;'''。数据聚合包括以一种便于分析的方式将数据（可能来自不同的来源）组合在一起（但这也可能使私人、个人级别的数据的识别变得可推断或以其他方式显而易见）。但这并不是数据挖掘本身，而是在分析之前以及为分析目的准备数据的结果。当数据被编译后，数据挖掘者或任何有权访问新编译的数据集的人能够识别特定的个人，特别是当数据最初是匿名的时，对个人隐私的威胁就开始发挥作用了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It is recommended{{whom|date=August 2019}} to be aware of the following '''before''' data are collected:&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
It is recommended to be aware of the following before data are collected:&lt;br /&gt;
&lt;br /&gt;
在收集数据之前，建议注意以下事项:&lt;br /&gt;
&lt;br /&gt;
* The purpose of the data collection and any (known) data mining projects;&lt;br /&gt;
&lt;br /&gt;
数据收集和任何（已知的）数据挖掘项目的目的；&lt;br /&gt;
&lt;br /&gt;
* How the data will be used;&lt;br /&gt;
&lt;br /&gt;
数据使用的方法；&lt;br /&gt;
&lt;br /&gt;
* Who will be able to mine the data and use the data and their derivatives;&lt;br /&gt;
&lt;br /&gt;
谁将能够挖掘数据并使用这些数据及其衍生工具；&lt;br /&gt;
&lt;br /&gt;
* The status of security surrounding access to the data;&lt;br /&gt;
&lt;br /&gt;
数据访问的安全状态；&lt;br /&gt;
&lt;br /&gt;
* How collected data can be updated.&lt;br /&gt;
&lt;br /&gt;
如何更新收集的数据。&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to ''become'' anonymous, so that individuals may not readily be identified.&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt; However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&amp;lt;ref&amp;gt;[http://www.securityfocus.com/brief/277 ''AOL search data identified individuals''], SecurityFocus, August 2006&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to become anonymous, so that individuals may not readily be identified.However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&lt;br /&gt;
&lt;br /&gt;
数据也可以被修改成匿名的，这样个人就不容易被修改了确定。但是，甚至“匿名化”的数据集也可能包含足够的信息用来识别个人，就像记者能够根据一组无意中搜索历史找到几个个人一样美国在线发布。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of [[personally identifiable information]] leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of [[privacy violation]], the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&amp;lt;ref&amp;gt;{{Cite journal|title = Big data׳s impact on privacy, security and consumer welfare|journal = Telecommunications Policy|pages = 1134–1145|volume = 38|issue = 11|doi = 10.1016/j.telpol.2014.10.002|first = Nir|last = Kshetri|year = 2014|url = http://libres.uncg.edu/ir/uncg/f/N_Kshetri_Big_2014.pdf}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of personally identifiable information leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of privacy violation, the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
无意中泄露个人身份信息导致提供者违反了公平信息惯例。这种轻率的行为会对指定的个人造成经济、情感或身体伤害。在一起侵犯隐私的案例中，沃尔格林 Walgreens的赞助人在2011年对该公司提起诉讼，指控该公司向数据挖掘公司出售处方信息，而数据挖掘公司又将这些数据提供给制药公司。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲的情况 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[European Union|Europe]] has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the [[International Safe Harbor Privacy Principles|U.S.-E.U. Safe Harbor Principles]], developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of [[Edward Snowden]]'s [[global surveillance disclosure]], there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the [[National Security Agency]], and attempts to reach an agreement with the United States have failed.&amp;lt;ref&amp;gt;{{cite web |url=https://crsreports.congress.gov/product/pdf/R/R44257/7 |title=U.S.-E.U. Data Privacy: From Safe Harbor to Privacy Shield |last1=Weiss |first1=Martin A. |last2=Archick |first2=Kristin |date=19 May 2016 |department= |website= |series= |agency=Congressional Research Service |location=Washington, D.C. |page=6 |pages= |format=PDF |id=R44257 |access-date=9 April 2020 |quote=On October 6, 2015, the [[Court of Justice of the European Union|CJEU]]&amp;amp;nbsp;... issued a decision that invalidated Safe Harbor (effective immediately), as currently implemented. }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Europe has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the U.S.-E.U. Safe Harbor Principles, developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of Edward Snowden's global surveillance disclosure, there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the National Security Agency, and attempts to reach an agreement with the United States have failed.&lt;br /&gt;
&lt;br /&gt;
欧洲有相当强的隐私法，正在努力进一步加强消费者的权利。然而，1998年至2000年期间制定的《美国-欧盟安全港原则》（U.S.-E.U.Safe Harbor Principles）目前有效地使欧洲用户受到美国公司的隐私剥削。由于爱德华·斯诺登 Edward Snowden披露了全球监控信息后，关于撤销这一协议的讨论越来越多，尤其是数据将完全暴露给国家安全局，与美国达成协议的尝试也失败了。&lt;br /&gt;
&lt;br /&gt;
===美国的情况 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the [[US Congress]] via the passage of regulatory controls such as the [[Health Insurance Portability and Accountability Act]] (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in ''Biotech Business Week'', &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot;&amp;lt;ref&amp;gt;Biotech Business Week Editors (June 30, 2008); ''BIOMEDICINE; HIPAA Privacy Rule Impedes Biomedical Research'', Biotech Business Week, retrieved 17 November 2009 from LexisNexis Academic&amp;lt;/ref&amp;gt; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the US Congress via the passage of regulatory controls such as the Health Insurance Portability and Accountability Act (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in Biotech Business Week, &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
在美国，美国国会通过了《健康保险便携性和责任法案》（HIPAA）等监管措施，解决了隐私问题。HIPAA要求个人就其提供的信息及其当前和未来的预期用途给予“知情同意”。根据《生物技术商业周刊》的一篇文章，“在实践中，HIPAA可能不会比研究领域长期存在的法规提供更大的保护。”。更重要的是，该规则通过知情同意进行保护的目标是接近普通个人的不可理解程度。”这突出了数据聚合和挖掘实践中数据匿名的必要性。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the [[Family Educational Rights and Privacy Act]] (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the Family Educational Rights and Privacy Act (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
美国信息隐私立法，如 HIPAA 和《家庭教育权利和隐私法》（FERPA）仅适用于每一个此类法律所涉及的特定领域。美国大多数企业对数据挖掘的使用并不受任何法律的控制。&lt;br /&gt;
&lt;br /&gt;
== 数据挖掘与著作权法 Copyright law==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Under [[Copyright law of the European Union|European copyright]] and [[Database Directive|database law]]s, the mining of in-copyright works (such as by [[web mining]]) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright{{snd}} but database rights may exist so data mining becomes subject to [[intellectual property]] owners' rights that are protected by the [[Database Directive]]. On the recommendation of the [[Hargreaves review]], this led to the UK government to amend its copyright law in 2014 to allow content mining as a [[Limitations and exceptions to copyright|limitation and exception]].&amp;lt;ref&amp;gt;[http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ UK Researchers Given Data Mining Right Under New UK Copyright Laws.] {{webarchive |url=https://web.archive.org/web/20140609020315/http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ |date=June 9, 2014 }} ''Out-Law.com.''   Retrieved 14 November 2014&amp;lt;/ref&amp;gt; The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the [[Information Society Directive]] (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
Under European copyright and database laws, the mining of in-copyright works (such as by web mining) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright but database rights may exist so data mining becomes subject to intellectual property owners' rights that are protected by the Database Directive. On the recommendation of the Hargreaves review, this led to the UK government to amend its copyright law in 2014 to allow content mining as a limitation and exception. The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the Information Society Directive (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
根据欧洲版权法和数据库法，未经版权所有人许可而对版权作品进行挖掘（如通过网络挖掘）是不合法的。在欧洲，如果数据库是纯数据，可能没有版权，但数据库权利可能存在，因此数据挖掘受数据库指令保护的知识产权所有者的权利约束。根据《哈格里夫斯评论》（Hargreaves review）的建议，这导致英国政府在2014年修订了版权法，允许将内容挖掘作为一种限制和例外。英国是继日本之后世界上第二个这样做的国家，日本在2009年引入了数据挖掘的例外。然而，由于信息社会指令（2001年）的限制，英国是例外情况但是只允许非商业目的的内容挖掘。英国版权法也不允许合同条款和条件推翻这一规定。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The [[European Commission]] facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe.&amp;lt;ref&amp;gt;{{cite web|title=Licences for Europe - Structured Stakeholder Dialogue 2013|url=http://ec.europa.eu/licences-for-europe-dialogue/en/content/about-site|website=European Commission|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt; The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and [[open access]] publishers to leave the stakeholder dialogue in May 2013.&amp;lt;ref&amp;gt;{{cite web|title=Text and Data Mining:Its importance and the need for change in Europe|url=http://libereurope.eu/news/text-and-data-mining-its-importance-and-the-need-for-change-in-europe/|website=Association of European Research Libraries|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The European Commission facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe. The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and open access publishers to leave the stakeholder dialogue in May 2013.&lt;br /&gt;
&lt;br /&gt;
2013年，欧盟委员会以“欧洲许可证”为题，推动了利益相关者对文本和数据挖掘的讨论。但他们将重点放在解决这一法律问题上，如许可证而不是限制和例外，导致大学、研究人员、图书馆、民间社会团体和开放获取出版商的代表于2013年5月离开了利益相关者对话。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===美国 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Copyright law of the United States|US copyright law]], and in particular its provision for [[fair use]], upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the [[Google Book Search Settlement Agreement|Google Book settlement]] the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&amp;lt;ref&amp;gt;{{cite web|title=Judge grants summary judgment in favor of Google Books — a fair use victory|url=http://www.lexology.com/library/detail.aspx?g=a18c5b92-5a20-4d1d-a098-a3095046a88e|website=Lexology.com|publisher=Antonelli Law Ltd|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
US copyright law, and in particular its provision for fair use, upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the Google Book settlement the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&lt;br /&gt;
&lt;br /&gt;
美国版权法，特别是其中关于合理使用的条款，支持在美国和其他合理使用国家，如以色列，台湾和韩国采矿内容的合法性。由于内容挖掘是变革性的，也就是说，它不会取代原来的工作，它被视为合法的合理使用。例如，作为谷歌图书和解协议的一部分，此案的主审法官裁定，谷歌版权图书数字化项目是合法的，部分原因在于数字化项目所展示的变革性用途——其中之一就是文本和数据挖掘。&lt;br /&gt;
&lt;br /&gt;
==软件 Software==&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Data mining and machine learning software}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===开源的数据挖掘软件 Free open-source data mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以使用免费 / 开源许可证。应用程序源代码也是对公众开放访问的。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Carrot2]]: Text and search results clustering framework.  文本和搜索结果聚类框架。&lt;br /&gt;
&lt;br /&gt;
* [[Chemicalize.org]]: A chemical structure miner and web search engine.  化学结构挖掘与网络搜索引擎。&lt;br /&gt;
&lt;br /&gt;
* [[ELKI]]: A university research project with advanced [[cluster analysis]] and [[anomaly detection|outlier detection]] methods written in the [[Java (programming language)|Java]] language.  一个大学研究项目，用Java语言编写高级聚类分析和离群点检测方法。&lt;br /&gt;
&lt;br /&gt;
* [[General Architecture for Text Engineering|GATE]]: a [[natural language processing]] and language engineering tool.  一个自然语言处理和语言工程工具。&lt;br /&gt;
&lt;br /&gt;
* [[KNIME]]: The Konstanz Information Miner, a user-friendly and comprehensive data analytics framework.  Konstanz Information Miner，一个用户友好的综合数据分析框架。&lt;br /&gt;
&lt;br /&gt;
* [[MOA (Massive Online Analysis)|Massive Online Analysis (MOA)]]: a real-time big data stream mining with concept drift tool in the [[Java (programming language)|Java]] programming language.  利用Java语言中的概念漂移工具进行实时大数据流挖掘。&lt;br /&gt;
&lt;br /&gt;
* [[Multi expression programming|MEPX]] - cross-platform tool for regression and classification problems based on a Genetic Programming variant.  基于遗传编程变量的回归和分类问题的跨平台工具。&lt;br /&gt;
&lt;br /&gt;
* ML-Flex: A software package that enables users to integrate with third-party machine-learning packages written in any programming language, execute classification analyses in parallel across multiple computing nodes, and produce HTML reports of classification results.  一种软件包，使用户能够与用任何编程语言编写的第三方机器学习包集成，跨多个计算节点并行执行分类分析，并生成分类结果的HTML报告。&lt;br /&gt;
&lt;br /&gt;
* [[mlpack]]: a collection of ready-to-use machine learning algorithms written in the [[C++]] language. 一个用C++语言编写的机器学习算法的集合。&lt;br /&gt;
&lt;br /&gt;
* [[NLTK]] ([[Natural Language Toolkit]]): A suite of libraries and programs for symbolic and statistical natural language processing (NLP) for the [[Python (programming language)|Python]] language.  一套用于Python语言的符号和统计自然语言处理（NLP）的库和程序。&lt;br /&gt;
&lt;br /&gt;
* [[OpenNN]]: Open [[neural networks]] library.  开源的神经网络库。&lt;br /&gt;
&lt;br /&gt;
* [[Orange (software)|Orange]]: A component-based data mining and [[machine learning]] software suite written in the [[Python (programming language)|Python]] language. 一个用Python语言编写的基于组件的数据挖掘和机器学习软件套件。&lt;br /&gt;
&lt;br /&gt;
* [[R (programming language)|R]]: A [[programming language]] and software environment for [[statistics|statistical]] computing, data mining, and graphics. It is part of the [[GNU Project]]. 一种用于统计计算、数据挖掘和图形的编程语言和软件环境。它是GNU项目的一部分。&lt;br /&gt;
&lt;br /&gt;
* [[scikit-learn]] is an open-source machine learning library for the Python programming language  是Python编程语言的一个开源机器学习库&lt;br /&gt;
&lt;br /&gt;
* [[Torch (machine learning)|Torch]]: An [[open source model|open-source]] [[deep learning]] library for the [[Lua (programming language)|Lua]] programming language and [[scientific computing]] framework with wide support for [[machine learning]] algorithms.  一个开源的深度学习lib库语言和科学计算框架，广泛支持机器学习算法。&lt;br /&gt;
&lt;br /&gt;
* [[UIMA]]: The UIMA (Unstructured Information Management Architecture) is a component framework for analyzing unstructured content such as text, audio and video – originally developed by IBM.  UIMA（非结构化信息管理体系结构）是一个用于分析非结构化内容（如文本、音频和视频）的组件框架，最初由IBM开发。&lt;br /&gt;
&lt;br /&gt;
* [[Weka (machine learning)|Weka]]: A suite of machine learning software applications written in the [[Java (programming language)|Java]] programming language.  用Java编程语言编写的一套机器学习软件应用程序。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===需要专有许可的数据挖掘软件和应用程序 Proprietary data-mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以根据专有许可证提供。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Angoss]] KnowledgeSTUDIO: data mining tool  数据挖掘工具。&lt;br /&gt;
&lt;br /&gt;
* [[LIONsolver]]: an integrated software application for data mining, business intelligence, and modeling that implements the Learning and Intelligent OptimizatioN (LION) approach.  用于数据挖掘、商业智能和建模的集成软件应用程序，实现学习和智能优化（LION）方法。&lt;br /&gt;
&lt;br /&gt;
* Megaputer Intelligence: data and text mining software is called PolyAnalyst.  数据和文本挖掘软件PolyAnalyst。&lt;br /&gt;
&lt;br /&gt;
* [[Microsoft Analysis Services]]: data mining software provided by [[Microsoft]].  微软提供的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[NetOwl]]: suite of multilingual text and entity analytics products that enable data mining.  支持数据挖掘的多语言文本和实体分析产品套件。&lt;br /&gt;
&lt;br /&gt;
* [[Oracle Data Mining]]: data mining software by [[Oracle Corporation]].  Oracle公司的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[PSeven]]: platform for automation of engineering simulation and analysis, multidisciplinary optimization and data mining provided by [[DATADVANCE]].  DATADVANCE为工程仿真分析、多学科优化和数据挖掘提供自动化平台。&lt;br /&gt;
&lt;br /&gt;
* [[Qlucore]] Omics Explorer: data mining software.  数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[RapidMiner]]: An environment for [[machine learning]] and data mining experiments. &amp;lt;!-- Latest version is NOT opensource --&amp;gt;  一个用于机器学习和数据挖掘实验的环境。&lt;br /&gt;
&lt;br /&gt;
* [[SAS (software)#Components|SAS Enterprise Miner]]: data mining software provided by the [[SAS Institute]].  SAS机构提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[SPSS Modeler]]: data mining software provided by [[IBM]].  IBM提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[STATISTICA]] Data Miner: data mining software provided by [[StatSoft]].  StatSoft提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[Tanagra (machine learning)|Tanagra]]: Visualisation-oriented data mining software, also for teaching.  面向可视化的数据挖掘软件，也用于教学。&lt;br /&gt;
&lt;br /&gt;
* [[Vertica]]: data mining software provided by [[Hewlett-Packard]].  惠普提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
==扩展链接 See also==&lt;br /&gt;
&lt;br /&gt;
; Methods&lt;br /&gt;
&lt;br /&gt;
方法&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Agent mining]]  主体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection|Anomaly/outlier/change detection]]  异常/异常/变化检测&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]]  关联规则学习&lt;br /&gt;
&lt;br /&gt;
* [[Bayesian network]]s  贝叶斯网络&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]]  分类&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis]]  聚类分析&lt;br /&gt;
&lt;br /&gt;
* [[Decision tree]]s  决策树&lt;br /&gt;
&lt;br /&gt;
* [[Ensemble learning]]  集成学习&lt;br /&gt;
&lt;br /&gt;
* [[Factor analysis]]  因子分析&lt;br /&gt;
&lt;br /&gt;
* [[Genetic algorithms]]  遗传算法&lt;br /&gt;
&lt;br /&gt;
* [[Intention mining]]  意向玩具&lt;br /&gt;
&lt;br /&gt;
* [[Learning classifier system]]  学习分类器系统&lt;br /&gt;
&lt;br /&gt;
* [[Multilinear subspace learning]]  多线性子空间学习&lt;br /&gt;
&lt;br /&gt;
* [[Artificial neural network|Neural network]]s  神经网络&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis]]  回归分析&lt;br /&gt;
&lt;br /&gt;
* [[Sequence mining]]   序列挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Structured data analysis (statistics)|Structured data analysis]]  结构数据学习&lt;br /&gt;
&lt;br /&gt;
* [[Support vector machines]]  支持向量机&lt;br /&gt;
&lt;br /&gt;
* [[Text mining]]  文本挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Time series|Time series analysis]]  时间序列分析&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application domains&lt;br /&gt;
&lt;br /&gt;
应用领域&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Analytics]] 分析&lt;br /&gt;
&lt;br /&gt;
* [[Behavior informatics]]  行为信息学&lt;br /&gt;
&lt;br /&gt;
* [[Big Data|Big data]]  大数据&lt;br /&gt;
&lt;br /&gt;
* [[Bioinformatics]]  生物信息学&lt;br /&gt;
&lt;br /&gt;
* [[Business intelligence]]  商务智能&lt;br /&gt;
&lt;br /&gt;
* [[Data analysis]]  数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Data warehouse]]  数据仓库&lt;br /&gt;
&lt;br /&gt;
* [[Decision support system]]  决策支持系统&lt;br /&gt;
&lt;br /&gt;
* [[Domain driven data mining]]  域驱动的数据挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Drug discovery]]  药物发现&lt;br /&gt;
&lt;br /&gt;
* [[Exploratory data analysis]]  探索性数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Predictive analytics]]  预测分析&lt;br /&gt;
&lt;br /&gt;
* [[Web mining]]  网页挖掘&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application examples&lt;br /&gt;
&lt;br /&gt;
应用示例&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|=&lt;br /&gt;
&lt;br /&gt;
*[[Automatic number plate recognition in the United Kingdom#Data mining|Automatic number plate recognition in the United Kingdom]]  英国的自动车牌识别&lt;br /&gt;
&lt;br /&gt;
*[[Customer analytics#Data mining|Customer analytics]]  客户分析&lt;br /&gt;
&lt;br /&gt;
*[[Educational data mining]]  教育数据挖掘&lt;br /&gt;
&lt;br /&gt;
*[[National Security Agency#Transaction data mining|National Security Agency]]  国家安全局&lt;br /&gt;
&lt;br /&gt;
*[[Quantitative structure–activity relationship#Data mining approach|Quantitative structure–activity relationship]]  数量结构-活动关系&lt;br /&gt;
&lt;br /&gt;
*[[Surveillance#Data mining and profiling|Surveillance]] / [[Mass surveillance#Data mining|Mass surveillance]] (e.g., [[Stellar Wind (code name)|Stellar Wind]])&lt;br /&gt;
监控/大规模监测（例如，恒星风）&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Related topics&lt;br /&gt;
&lt;br /&gt;
相关话题&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to ''analyzing'' data) , see:&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to analyzing data) , see:&lt;br /&gt;
&lt;br /&gt;
有关从数据中提取信息(与分析数据相反)的详细信息，请参阅:&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Data integration]]  数据集成&lt;br /&gt;
&lt;br /&gt;
* [[Data transformation]]  数据转换&lt;br /&gt;
&lt;br /&gt;
* [[Electronic discovery]]  电子发现&lt;br /&gt;
&lt;br /&gt;
* [[Information extraction]]  信息提取&lt;br /&gt;
&lt;br /&gt;
* [[Information integration]]  信息集成&lt;br /&gt;
&lt;br /&gt;
* [[Named-entity recognition]]  命名实体识别&lt;br /&gt;
&lt;br /&gt;
* [[Profiling (information science)]]  分析（信息科学）&lt;br /&gt;
&lt;br /&gt;
* [[Psychometrics]]  心理测量学&lt;br /&gt;
&lt;br /&gt;
* [[Social media mining]]  社交媒体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Surveillance capitalism]]  资本监视&lt;br /&gt;
&lt;br /&gt;
* [[Web scraping]]  网页抓取&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
;Other resources&lt;br /&gt;
&lt;br /&gt;
Other resources&lt;br /&gt;
&lt;br /&gt;
其他资源&lt;br /&gt;
&lt;br /&gt;
*[[International Journal of Data Warehousing and Mining]]  国际数据仓库与挖掘杂志&lt;br /&gt;
&lt;br /&gt;
==参考文献 References==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|30em}}&lt;br /&gt;
&lt;br /&gt;
==进一步阅读 Further reading==&lt;br /&gt;
&lt;br /&gt;
{{div col|colwidth=30em}}&lt;br /&gt;
&lt;br /&gt;
* Cabena, Peter; Hadjnian, Pablo; Stadler, Rolf; Verhees, Jaap; Zanasi, Alessandro (1997); ''Discovering Data Mining: From Concept to Implementation'', [[Prentice Hall]], {{ISBN|0-13-743980-6}}&lt;br /&gt;
&lt;br /&gt;
* M.S. Chen, J. Han, [[Philip S. Yu|P.S. Yu]] (1996) &amp;quot;[http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/chen_tkde96.pdf Data mining: an overview from a database perspective]&amp;quot;. ''Knowledge and data Engineering, IEEE Transactions'' on 8 (6), 866–883&lt;br /&gt;
&lt;br /&gt;
* Feldman, Ronen; Sanger, James (2007); ''The Text Mining Handbook'', [[Cambridge University Press]], {{ISBN|978-0-521-83657-9}}&lt;br /&gt;
&lt;br /&gt;
* Guo, Yike; and Grossman, Robert (editors) (1999); ''High Performance Data Mining: Scaling Algorithms, Applications and Systems'', [[Kluwer Academic Publishers]]&lt;br /&gt;
&lt;br /&gt;
* [[Jiawei Han|Han, Jiawei]], Micheline Kamber, and Jian Pei. ''Data mining: concepts and techniques''. Morgan kaufmann, 2006.&lt;br /&gt;
&lt;br /&gt;
* [[Trevor Hastie|Hastie, Trevor]], [[Robert Tibshirani|Tibshirani, Robert]] and [[Jerome H. Friedman|Friedman, Jerome]] (2001); ''The Elements of Statistical Learning: Data Mining, Inference, and Prediction'', Springer, {{ISBN|0-387-95284-5}}&lt;br /&gt;
&lt;br /&gt;
* [[Bing Liu (computer scientist)|Liu, Bing]] (2007, 2011); ''Web Data Mining: Exploring Hyperlinks, Contents and Usage Data'', [[Springer Verlag|Springer]], {{ISBN|3-540-37881-2}}&lt;br /&gt;
&lt;br /&gt;
* {{cite journal |last=Murphy |first=Chris |date=16 May 2011 |title=Is Data Mining Free Speech? |journal=[[InformationWeek]] |page=12 }}&lt;br /&gt;
&lt;br /&gt;
* Nisbet, Robert; Elder, John; Miner, Gary (2009); ''Handbook of Statistical Analysis &amp;amp; Data Mining Applications'', [[Academic Press]]/Elsevier, {{ISBN|978-0-12-374765-5}}&lt;br /&gt;
&lt;br /&gt;
* Poncelet, Pascal; Masseglia, Florent; and Teisseire, Maguelonne (editors) (October 2007); &amp;quot;Data Mining Patterns: New Methods and Applications&amp;quot;, ''Information Science Reference'', {{ISBN|978-1-59904-162-9}}&lt;br /&gt;
&lt;br /&gt;
* Tan, Pang-Ning; Steinbach, Michael; and Kumar, Vipin (2005); ''Introduction to Data Mining'', {{ISBN|0-321-32136-7}}&lt;br /&gt;
&lt;br /&gt;
* Theodoridis, Sergios; and Koutroumbas, Konstantinos (2009); ''Pattern Recognition'', 4th Edition, Academic Press, {{ISBN|978-1-59749-272-0}}&lt;br /&gt;
&lt;br /&gt;
* Weiss, Sholom M.; and Indurkhya, Nitin (1998); ''Predictive Data Mining'', [[Morgan Kaufmann]]&lt;br /&gt;
&lt;br /&gt;
* {{cite book |author1=Witten, Ian H.|authorlink1=Ian H. Witten |author2=Frank, Eibe |author3=Hall, Mark A. |title=Data Mining: Practical Machine Learning Tools and Techniques |edition=3 |date=30 January 2011 |publisher=Elsevier |isbn=978-0-12-374856-0 }} (See also [[Weka (machine learning)|Free Weka software]])&lt;br /&gt;
&lt;br /&gt;
* Ye, Nong (2003); ''The Handbook of Data Mining'', Mahwah, NJ: Lawrence Erlbaum&lt;br /&gt;
&lt;br /&gt;
{{div col end}}&lt;br /&gt;
&lt;br /&gt;
==相关链接External links==&lt;br /&gt;
&lt;br /&gt;
{{Commons category|Data mining}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Reference/Knowledge_Management/Knowledge_Discovery/Software|Knowledge Discovery Software}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Computers/Software/Databases/Data_Mining/Tool_Vendors|Data Mining Tool Vendors}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{data}}&lt;br /&gt;
&lt;br /&gt;
{{Data warehouse}}&lt;br /&gt;
&lt;br /&gt;
{{Computer science}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{Authority control}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{DEFAULTSORT:Data Mining}}&lt;br /&gt;
&lt;br /&gt;
[[Category:Data mining| ]]&lt;br /&gt;
&lt;br /&gt;
[[Category:Formal sciences]]&lt;br /&gt;
&lt;br /&gt;
Category:Formal sciences&lt;br /&gt;
&lt;br /&gt;
类别: 正规科学&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Data mining]]. Its edit history can be viewed at [[数据挖掘/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13899</id>
		<title>数据挖掘</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13899"/>
		<updated>2020-09-11T05:28:27Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条由许菁翻译整理。&lt;br /&gt;
&lt;br /&gt;
{{Machine learning bar}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Data mining''' is the process of discovering patterns in large [[data set]]s involving methods at the intersection of [[machine learning]], [[statistics]], and [[database system]]s.&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; Data mining is an [[interdisciplinary]] subfield of [[computer science]] and [[statistics]] with an overall goal to extract information (with intelligent methods) from a data set and transform the information into a comprehensible structure for further use.&amp;lt;ref name=&amp;quot;acm&amp;quot;&amp;gt;{{cite web |url=http://www.kdd.org/curriculum/index.html |title=Data Mining Curriculum |publisher=[[Association for Computing Machinery|ACM]] [[SIGKDD]] |date=2006-04-30 |accessdate=2014-01-27 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;brittanica&amp;quot;&amp;gt;{{cite web |last=Clifton |first=Christopher |title=Encyclopædia Britannica: Definition of Data Mining |year=2010 |url=http://www.britannica.com/EBchecked/topic/1056150/data-mining |accessdate=2010-12-09 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;elements&amp;quot;&amp;gt;{{cite web|last1=Hastie|first1=Trevor|authorlink1=Trevor Hastie|last2=Tibshirani|first2=Robert|authorlink2=Robert Tibshirani|last3=Friedman|first3=Jerome|authorlink3=Jerome H. Friedman|title=The Elements of Statistical Learning: Data Mining, Inference, and Prediction|year=2009|url=http://www-stat.stanford.edu/~tibs/ElemStatLearn/|accessdate=2012-08-07|archive-url=https://web.archive.org/web/20091110212529/http://www-stat.stanford.edu/~tibs/ElemStatLearn/|archive-date=2009-11-10|url-status=dead}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book|last1=Han, Kamber, Pei|first1=Jaiwei, Micheline, Jian|title=Data Mining: Concepts and Techniques|date=June 9, 2011|publisher=Morgan Kaufmann|isbn=978-0-12-381479-1|edition=3rd}}&amp;lt;/ref&amp;gt; Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt; Aside from the raw analysis step, it also involves database and [[data management]] aspects, [[data pre-processing]], [[statistical model|model]] and [[Statistical inference|inference]] considerations, interestingness metrics, [[Computational complexity theory|complexity]] considerations, post-processing of discovered structures, [[Data visualization|visualization]], and [[Online algorithm|online updating]].&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; &lt;br /&gt;
&lt;br /&gt;
Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD. Aside from the raw analysis step, it also involves database and data management aspects, data pre-processing, model and inference considerations, interestingness metrics, complexity considerations, post-processing of discovered structures, visualization, and online updating. &lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘 Data Mining &amp;lt;/font&amp;gt;'''是在大型数据集中发现模式的过程，是一种涉及到机器学习、统计学和数据库系统综合使用的方法。数据挖掘是指“在数据库中发现知识(knowledge discovery in databases,KDD)”过程中的分析步骤。除了传统的分析步骤，它还涉及数据库和数据管理方面，包括数据预处理、模型和推理考虑、兴趣度量、复杂性考虑、发现结构的后处理、可视化和在线更新等内容。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“数据挖掘是指“在数据库中知识发现KDD”的过程的分析步骤”一句中的“在数据库中知识发现KDD”处改为“在数据库中发现知识(knowledge discovery in databases,KDD)”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a [[misnomer]], because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (''mining'') of data itself.&amp;lt;ref name=&amp;quot;han-kamber&amp;quot;&amp;gt;{{cite book|title=Data mining: concepts and techniques|last1=Han|first1=Jiawei|last2=Kamber|first2=Micheline|date=2001|publisher=[[Morgan Kaufmann]]|isbn=978-1-55860-489-6|page=5|quote=Thus, data mining should have been more appropriately named &amp;quot;knowledge mining from data,&amp;quot; which is unfortunately somewhat long|authorlink1=Jiawei Han}}&amp;lt;/ref&amp;gt; It also is a [[buzzword]]&amp;lt;ref&amp;gt;[http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf OKAIRP 2005 Fall Conference, Arizona State University] {{Webarchive|url=https://web.archive.org/web/20140201170452/http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf|date=2014-02-01}}&amp;lt;/ref&amp;gt; and is frequently applied to any form of large-scale data or [[information processing]] ([[Data collection|collection]], [[information extraction|extraction]], [[Data warehouse|warehousing]], analysis, and statistics) as well as any application of [[Decision support system|computer decision support system]], including [[artificial intelligence]] (e.g., machine learning) and [[business intelligence]]. The book ''Data mining: Practical machine learning tools and techniques with Java''&amp;lt;ref name=&amp;quot;witten&amp;quot;&amp;gt;{{cite book|title=Data Mining: Practical Machine Learning Tools and Techniques|last1=Witten|first1=Ian H.|last2=Frank|first2=Eibe|last3=Hall|first3=Mark A.|date=30 January 2011|publisher=Elsevier|isbn=978-0-12-374856-0|edition=3|authorlink1=Ian H. Witten}}&amp;lt;/ref&amp;gt; (which covers mostly machine learning material) was originally to be named just ''Practical machine learning'', and the term ''data mining'' was only added for marketing reasons.&amp;lt;ref&amp;gt;{{Cite journal|author1=Bouckaert, Remco R.|author2=Frank, Eibe|author3=Hall, Mark A.|author4=Holmes, Geoffrey|author5=Pfahringer, Bernhard|author6=Reutemann, Peter|author7=Witten, Ian H.|authorlink7=Ian H. Witten|year=2010|title=WEKA Experiences with a Java open-source project|journal=Journal of Machine Learning Research|volume=11|pages=2533–2541|quote=the original title, &amp;quot;Practical machine learning&amp;quot;, was changed&amp;amp;nbsp;... The term &amp;quot;data mining&amp;quot; was [added] primarily for marketing reasons.|postscript={{inconsistent citations}}}}&amp;lt;/ref&amp;gt; Often the more general terms (''large scale'') ''[[data analysis]]'' and ''[[analytics]]'' – or, when referring to actual methods, ''artificial intelligence'' and ''machine learning'' – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a misnomer, because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (mining) of data itself. It also is a buzzword and is frequently applied to any form of large-scale data or information processing (collection, extraction, warehousing, analysis, and statistics) as well as any application of computer decision support system, including artificial intelligence (e.g., machine learning) and business intelligence. The book Data mining: Practical machine learning tools and techniques with Java (which covers mostly machine learning material) was originally to be named just Practical machine learning, and the term data mining was only added for marketing reasons. Often the more general terms (large scale) data analysis and analytics – or, when referring to actual methods, artificial intelligence and machine learning – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
“数据挖掘”这种形容其实并不十分恰当，因为我们的目标是从大量数据中提取模式和知识，而不是数据本身的提取(挖掘)。它是一个流行语，经常用于任何形式的大规模数据或信息处理（收集、提取、仓储、分析和统计）的场景下，以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 计算机决策系统 Decision Support System，DSS&amp;lt;/font&amp;gt;'''的任何应用当中，包括人工智能（例如机器学习）和商业智能。《数据挖掘：使用Java的实用机器学习工具和技术》（主要涵盖机器学习材料）一书最初被命名为“实用机器学习”，而数据挖掘一词只是为了营销的原因而增加。经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适”一句改为“经常来说，更一般的术语如（大规模）数据分析，或实际的方法如人工智能和机器学习，是更合适的表达方式”&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records ([[cluster analysis]]), unusual records ([[anomaly detection]]), and dependencies ([[association rule mining]], [[sequential pattern mining]]). This usually involves using database techniques such as [[spatial index|spatial indices]]. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and [[predictive analytics]]. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a [[decision support system]]. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records (cluster analysis), unusual records (anomaly detection), and dependencies (association rule mining, sequential pattern mining). This usually involves using database techniques such as spatial indices. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and predictive analytics. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a decision support system. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
实际上数据挖掘任务是对大量数据进行半自动或全自动分析，以提取出从前未知的且有趣的模式，如数据记录组(数据聚类)、异常记录组(异常检测)和依赖关系(关联规则挖掘，序列挖掘)。这通常涉及使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种汇总，并且可以用于进一步的分析，或者，例如，机器学习和预测分析。例如，数据挖掘步骤可以识别数据中的多个组，然后可以使用该步骤通过决策支持系统获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是作为附加步骤属于整个 KDD 过程。&lt;br /&gt;
&lt;br /&gt;
如数据记录组（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''）、异常记录（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly Detection&amp;lt;/font&amp;gt;'''）和依赖关系（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则挖掘 Association Rule Mining&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;序列模式挖掘 Sequential Pattern Mining&amp;lt;/font&amp;gt;'''）。这通常涉及到使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种规律总结，可以用于进一步的分析，或者，例如，在机器学习和预测分析中。例如，通过数据挖掘可以出识别数据中的多个组，然后这些组可以通过使用决策支持系统来获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是属于整个KDD过程的附加步骤。&lt;br /&gt;
&lt;br /&gt;
The difference between [[data analysis]] and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&amp;lt;ref&amp;gt;Olson, D. L. (2007). Data mining in business services. ''Service Business'', ''1''(3), 181-193. {{doi|10.1007/s11628-006-0014-7}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The difference between data analysis and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据分析 Data Analysis&amp;lt;/font&amp;gt;'''和数据挖掘的区别在于，数据分析用于测试数据集上的模型和假设，例如，分析营销活动的有效性，而不考虑数据量的多少；相反，数据挖掘使用机器学习和统计模型来发现“大量”数据中的秘密或隐藏模式。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The related terms ''[[data dredging]]'', ''data fishing'', and ''data snooping'' refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
The related terms data dredging, data fishing, and data snooping refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
相关术语'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;“数据疏浚” Data Dredging&amp;lt;/font&amp;gt;'''、“数据钓鱼”和“数据窥探”是指使用数据挖掘方法对较大的人口数据集中的一部分进行抽样，这些数据集太小（或可能太小），无法对所发现的任何模式的有效性作出可靠的统计推断。但是，这些方法可以用于提出新的假设，以针对更大的数据群体进行测试。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==起源 Etymology==&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like ''data fishing'' or ''data dredging'' to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist [[Michael Lovell]] in an article published in the ''[[Review of Economic Studies]]'' in 1983.&amp;lt;ref&amp;gt;{{Cite journal|last=Lovell|first=Michael C.|date=1983|title=Data Mining|journal=The Review of Economics and Statistics|volume=65|issue=1|pages=1–12|doi=10.2307/1924403|jstor=1924403}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book |first=Wojciech W. |last=Charemza |first2=Derek F. |last2=Deadman |title=New Directions in Econometric Practice |location=Aldershot |publisher=Edward Elgar |year=1992 |chapter=Data Mining |pages=14–31 |isbn=1-85278-461-X }}&amp;lt;/ref&amp;gt; Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like data fishing or data dredging to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist Michael Lovell in an article published in the Review of Economic Studies in 1983. Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
在20世纪60年代，统计学家和经济学家们曾经使用“数据钓鱼”或”数据疏浚“等术语来指代他们认为在没有先验假设的情况下进行数据分析的糟糕做法。经济学家迈克尔•洛弗尔 Michael Lovell 在1983年《经济研究评论》（Review of Economic Studies）上发表的一篇文章中，也以类似的批判方式使用了“数据挖掘”这个术语。Lovell 指出，这种做法“伪装成各种别名，从“实验”(正面)到“钓鱼”或“窥探”(负面)。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term ''data mining'' appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation;&amp;lt;ref name=&amp;quot;Mena&amp;quot;&amp;gt;{{cite book |last=Mena |first=Jesús |year=2011 |title=Machine Learning Forensics for Law Enforcement, Security, and Intelligence |location=Boca Raton, FL |publisher=CRC Press (Taylor &amp;amp; Francis Group) |isbn=978-1-4398-6069-4 }}&amp;lt;/ref&amp;gt; researchers consequently turned to ''data mining''. Other terms used include ''data archaeology'', ''information harvesting'', ''information discovery'', ''knowledge extraction'', etc. [[Gregory I. Piatetsky-Shapiro|Gregory Piatetsky-Shapiro]] coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic [http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] and this term became more popular in [[Artificial intelligence|AI]] and [[machine learning]] community. However, the term data mining became more popular in the business and press communities.&amp;lt;ref&amp;gt;{{cite web |last1=Piatetsky-Shapiro |first1=Gregory |authorlink1=Gregory Piatetsky-Shapiro |last2=Parker |first2=Gary |url=http://www.kdnuggets.com/data_mining_course/x1-intro-to-data-mining-notes.html |title=Lesson: Data Mining, and Knowledge Discovery: An Introduction |publisher=KD Nuggets |year=2011 |work=Introduction to Data Mining |accessdate=30 August 2012 }}&amp;lt;/ref&amp;gt; Currently, the terms ''data mining'' and ''knowledge discovery'' are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
The term data mining appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation; researchers consequently turned to data mining. Other terms used include data archaeology, information harvesting, information discovery, knowledge extraction, etc. Gregory Piatetsky-Shapiro coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic (KDD-1989) and this term became more popular in AI and machine learning community. However, the term data mining became more popular in the business and press communities. Currently, the terms data mining and knowledge discovery are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
数据挖掘这个术语在1990年左右出现在数据库领域，通常有着积极的内涵。在20世纪80年代的一段短暂时间里，人们曾使用过“数据库挖掘”这种表达，但由于这个词被总部位于圣地亚哥的 HNC 公司注册为商标，因此研究人员转向了数据挖掘。曾用过的其他术语包括数据考古学、信息收集、信息发现、知识提取等。格雷戈里·皮亚特斯基·夏皮罗 Gregory Piatetsky-Shapiro 在关于这个主题的第一个研讨会[ http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] 上首次创造了“数据库中的知识发现 Knowledge Discovery in Databases，KDD”这个术语。此后，这个术语在人工智能和机器学习社区中变得更加流行。然而，数据挖掘这个术语在商业和出版界变得越来越流行。目前，数据挖掘和知识发现 knowledge discovery这两个术语可以互换使用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery ([[KDD-95]]) was started in Montreal under [[AAAI]] sponsorship. It was co-chaired by [[Usama Fayyad]] and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called [[Data Mining and Knowledge Discovery]] as its founding editor-in-chief. Later he started the [[SIGKDD]] Newsletter SIGKDD Explorations.&amp;lt;ref name=SIGKDD-explorations&amp;gt;{{cite journal|last1=Fayyad|first1=Usama|title=First Editorial by Editor-in-Chief|journal=SIGKDD Explorations|date=15 June 1999|volume=13|issue=1|pages=102|doi=10.1145/2207243.2207269|url=http://www.kdd.org/explorations/view/june-1999-volume-1-issue-1|accessdate=27 December 2010|ref=SIGKDD-explorations}}&amp;lt;/ref&amp;gt; The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal ''Data Mining and Knowledge Discovery'' is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery (KDD-95) was started in Montreal under AAAI sponsorship. It was co-chaired by Usama Fayyad and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called Data Mining and Knowledge Discovery as its founding editor-in-chief. Later he started the SIGKDD Newsletter SIGKDD Explorations.The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal Data Mining and Knowledge Discovery is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
在学术界，主要的研究论坛始于1995年，当时，在AAAI的赞助下，第一届数据挖掘和知识发现国际会议（KDD-95）在蒙特利尔召开。会议由乌萨马·法耶兹 Usama Fayyad和拉玛萨米·乌图鲁萨米 Ramasamy Uthurusamy共同主持。一年后，1996年Usama Fayyad创办了杂志《数据挖掘与知识发现》（datamining and Knowledge Discovery），担任创始主编。后来他创办了SIGKDD时事通讯探索。那个KDD国际会议也成为了数据挖掘领域质量最高的主要会议，其研究论文提交的接受率低于18%，而《数据挖掘与知识发现》也成为了该领域的主要研究期刊。&lt;br /&gt;
&lt;br /&gt;
==背景 Background==&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from [[data]] has occurred for centuries. Early methods of identifying patterns in data include [[Bayes' theorem]] (1700s) and [[regression analysis]] (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As [[data set]]s have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as [[neural networks]], [[cluster analysis]], [[genetic algorithms]] (1950s), [[decision tree learning|decision trees]] and [[decision rules]] (1960s), and [[support vector machines]] (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns&amp;lt;ref name=&amp;quot;Kantardzic&amp;quot;&amp;gt;{{cite book |last=Kantardzic |first=Mehmed |title=Data Mining: Concepts, Models, Methods, and Algorithms |year=2003 |publisher=John Wiley &amp;amp; Sons |isbn=978-0-471-22852-3 |oclc=50055336 |url-access=registration |url=https://archive.org/details/dataminingconcep0000kant }}&amp;lt;/ref&amp;gt; in large data sets. It bridges the gap from [[applied statistics]] and artificial intelligence (which usually provide the mathematical background) to [[database management]] by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from data has occurred for centuries. Early methods of identifying patterns in data include Bayes' theorem (1700s) and regression analysis (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As data sets have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as neural networks, cluster analysis, genetic algorithms (1950s), decision trees and decision rules (1960s), and support vector machines (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns in large data sets. It bridges the gap from applied statistics and artificial intelligence (which usually provide the mathematical background) to database management by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
从数据中手动提取模式的方法已经持续了好几个世纪了。早期识别数据模式的方法包括17世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;贝叶斯定理 Bayes' Theorem&amp;lt;/font&amp;gt;'''和19世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归分析 Regression Analysis&amp;lt;/font&amp;gt;'''。计算机技术的扩散、其普遍性和日益强大的能力极大地提高了数据的收集、存储和操作能力。随着数据集的规模和复杂性的增长，手动分析数据的方法越来越多地被更强的间接、自动化的数据处理所取代，这都得益于计算机科学其他领域取得的新的进步，特别是机器学习领域的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;神经网络 Neural Networks&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;遗传算法 Genetic Algorithms&amp;lt;/font&amp;gt;'''（1950年代），'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策树 Decision Tree&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策规则 Decision Rules&amp;lt;/font&amp;gt;'''（1960年代）以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;支持向量机 Support Vector Machines&amp;lt;/font&amp;gt;'''（1990年代）等。数据挖掘就是应用这些方法来发现大型数据集中的隐藏模式的过程。它利用数据在数据库中存储和索引的方式，更有效地执行实际的学习和发现算法，从而弥补了从应用统计学和人工智能(通常提供数学背景)到数据库管理之间的差距，使这些方法能够应用于更大的数据集。&lt;br /&gt;
&lt;br /&gt;
==发展过程 Process==&lt;br /&gt;
&lt;br /&gt;
The ''knowledge discovery in databases (KDD) process'' is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
The knowledge discovery in databases (KDD) process is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
数据库中的知识发现 Knowledge Discovery in Databases ，KDD过程通常定义为以下几个阶段:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Selection&lt;br /&gt;
&lt;br /&gt;
 Selection&lt;br /&gt;
&lt;br /&gt;
选择&lt;br /&gt;
&lt;br /&gt;
# Pre-processing&lt;br /&gt;
&lt;br /&gt;
 Pre-processing&lt;br /&gt;
&lt;br /&gt;
预处理&lt;br /&gt;
&lt;br /&gt;
# Transformation&lt;br /&gt;
&lt;br /&gt;
 Transformation&lt;br /&gt;
&lt;br /&gt;
转换&lt;br /&gt;
&lt;br /&gt;
# ''Data mining''&lt;br /&gt;
&lt;br /&gt;
 Data mining&lt;br /&gt;
&lt;br /&gt;
数据挖掘&lt;br /&gt;
&lt;br /&gt;
# Interpretation/evaluation.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
 Interpretation/evaluation.&lt;br /&gt;
&lt;br /&gt;
解释 / 评估。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the [[Cross-industry standard process for data mining]] (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the Cross-industry standard process for data mining (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
然而，它存在于这个主题的许多变体中，例如在'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘的跨行业标准流程 Cross-industry standard process for data mining，CRISP-DM&amp;lt;/font&amp;gt;'''中它定义了以下六个阶段：&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Business understanding&lt;br /&gt;
&lt;br /&gt;
 Business understanding&lt;br /&gt;
&lt;br /&gt;
商业理解&lt;br /&gt;
&lt;br /&gt;
# Data understanding&lt;br /&gt;
&lt;br /&gt;
 Data understanding&lt;br /&gt;
&lt;br /&gt;
数据理解&lt;br /&gt;
&lt;br /&gt;
# Data preparation&lt;br /&gt;
&lt;br /&gt;
 Data preparation&lt;br /&gt;
&lt;br /&gt;
数据准备&lt;br /&gt;
&lt;br /&gt;
# Modeling&lt;br /&gt;
&lt;br /&gt;
 Modeling&lt;br /&gt;
&lt;br /&gt;
建模&lt;br /&gt;
&lt;br /&gt;
# Evaluation&lt;br /&gt;
&lt;br /&gt;
 Evaluation&lt;br /&gt;
&lt;br /&gt;
评估&lt;br /&gt;
&lt;br /&gt;
# Deployment&lt;br /&gt;
&lt;br /&gt;
 Deployment&lt;br /&gt;
&lt;br /&gt;
部署&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
或一个简化的过程，包括：(1)预处理，(2)数据挖掘，(3)结果验证。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners.&amp;lt;ref&amp;gt;[[Gregory Piatetsky-Shapiro]] (2002) [http://www.kdnuggets.com/polls/2002/methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2004) [http://www.kdnuggets.com/polls/2004/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2007) [http://www.kdnuggets.com/polls/2007/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2014) [http://www.kdnuggets.com/polls/2014/analytics-data-mining-data-science-methodology.html ''KDnuggets Methodology Poll'']&amp;lt;/ref&amp;gt; The only other data mining standard named in these polls was [[SEMMA]]. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models,&amp;lt;ref name=&amp;quot;kurgan&amp;quot;&amp;gt;Lukasz Kurgan and Petr Musilek (2006); [http://journals.cambridge.org/action/displayAbstract?fromPage=online&amp;amp;aid=451120 ''A survey of Knowledge Discovery and Data Mining process models'']. The Knowledge Engineering Review. Volume 21 Issue 1, March 2006, pp&amp;amp;nbsp;1–24, Cambridge University Press, New York, NY, USA {{DOI|10.1017/S0269888906000737}}&amp;lt;/ref&amp;gt; and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&amp;lt;ref name=&amp;quot;AzevedoSantos&amp;quot;&amp;gt;Azevedo, A. and Santos, M. F. [http://www.iadis.net/dl/final_uploads/200812P033.pdf KDD, SEMMA and CRISP-DM: a parallel overview] {{webarchive|url=https://web.archive.org/web/20130109114939/http://www.iadis.net/dl/final_uploads/200812P033.pdf |date=2013-01-09 }}. In Proceedings of the IADIS European Conference on Data Mining 2008, pp&amp;amp;nbsp;182–185.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners. The only other data mining standard named in these polls was SEMMA. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models, and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&lt;br /&gt;
&lt;br /&gt;
在这些调查中，唯一的其他数据挖掘标准是SEMMA。然而，使用CRISP-DM的人数是其3-4倍。一些研究小组已经发表了关于数据挖掘过程模型的研究，例如阿泽维多 Azevedo和 桑托斯Santos曾在2008年对CRISP-DM和SEMMA这两套数据挖掘流程标准进行了比较。&lt;br /&gt;
&lt;br /&gt;
===预处理 Pre-processing===&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a [[data mart]] or [[data warehouse]]. Pre-processing is essential to analyze the [[Multivariate statistics|multivariate]] data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing [[statistical noise|noise]] and those with [[missing data]].&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a data mart or data warehouse. Pre-processing is essential to analyze the multivariate data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing noise and those with missing data.&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须先对目标数据集进行整合。由于数据挖掘只能发现数据中实际存在的模式，目标数据集必须足够大以包含这些模式，同时保持足够简洁以便在可接受的时间限制内进行挖掘。数据的公共源是数据集市或数据仓库。在数据挖掘之前，对多变量数据集进行预处理是必不可少的。然后清理目标集。数据清理去除了包含噪声的观测值和缺失数据的观测值。&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须组装目标数据集。由于数据挖掘只能发现数据中实际存在的模式，因此目标数据集必须足够大以包含这些模式，同时保持足够简洁，以便在可接受的时间限制内进行挖掘。数据的常见来源是'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据集市 Data Mart&amp;lt;/font&amp;gt;'''或'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据仓库 Data Warehouse&amp;lt;/font&amp;gt;'''。在数据挖掘之前，对'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;多元 Multivariate&amp;lt;/font&amp;gt;'''数据集进行预处理是必不可少的，然后对目标集进行清洗。数据清洗将删除包含'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;噪声 Noise&amp;lt;/font&amp;gt;'''的观测值和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;缺失数据 Missing Data&amp;lt;/font&amp;gt;'''的观测值。&lt;br /&gt;
&lt;br /&gt;
===数据挖掘 Data mining===&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&amp;lt;ref name=&amp;quot;Fayyad&amp;quot;&amp;gt;{{cite web |last1=Fayyad |first1=Usama |authorlink1=Usama Fayyad |last2=Piatetsky-Shapiro |first2=Gregory|authorlink2=Gregory Piatetsky-Shapiro |last3=Smyth |first3=Padhraic |title=From Data Mining to Knowledge Discovery in Databases |year=1996 |url=http://www.kdnuggets.com/gpspubs/aimag-kdd-overview-1996-Fayyad.pdf |accessdate = 17 December 2008 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&lt;br /&gt;
&lt;br /&gt;
数据挖掘涉及六类常见的任务:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection]] (outlier/change/deviation detection) – The identification of unusual data records, that might be interesting or data errors that require further investigation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly detection&amp;lt;/font&amp;gt;'''（异常值/变化/偏差检测）：识别异常数据记录，发现可能是有趣的或需要进一步调查的数据错误。&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]] (dependency modeling) – Searches for relationships between variables. For example, a supermarket might gather data on customer purchasing habits. Using association rule learning, the supermarket can determine which products are frequently bought together and use this information for marketing purposes. This is sometimes referred to as market basket analysis.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则学习 Association rule learning&amp;lt;/font&amp;gt;'''（依赖关系建模）：探变量之间的关系。例如，超市可能会收集顾客购买习惯的数据。通过使用关联规则学习，超市可以确定哪些产品经常被一起购买，并将这些信息用于营销策略改进。这种研究有时被称为“市场篮子分析”。&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis|Clustering]] – is the task of discovering groups and structures in the data that are in some way or another &amp;quot;similar&amp;quot;, without using known structures in the data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类 Clustering&amp;lt;/font&amp;gt;'''：是指在数据中发现以某种方式或其他方式“相似”的组和结构，而不使用数据中已知的结构。&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]] – is the task of generalizing known structure to apply to new data. For example, an e-mail program might attempt to classify an e-mail as &amp;quot;legitimate&amp;quot; or as &amp;quot;spam&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;分类 Classification&amp;lt;/font&amp;gt;'''：是将已知结构归纳为新数据的任务。例如，电子邮件程序可能会尝试将电子邮件分类为“合法”或“垃圾邮件”。&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis|Regression]] – attempts to find a function that models the data with the least error that is, for estimating the relationships among data or datasets.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归&amp;lt;/font&amp;gt;'''：试图找到一个对数据建模误差最小的函数，也就是说，用于估计数据或数据集之间的关系。&lt;br /&gt;
&lt;br /&gt;
* [[Automatic summarization|Summarization]] – providing a more compact representation of the data set, including visualization and report generation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;自动文摘 Automatic summarizatio&amp;lt;/font&amp;gt;'''：提供数据集更紧凑、简洁的表示，包括可视化和报告生成。&lt;br /&gt;
&lt;br /&gt;
===结果验证 Results validation===&lt;br /&gt;
&lt;br /&gt;
[[File:Spurious correlations - spelling bee spiders.svg|thumb|An example of data produced by [[data dredging]] through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence. 一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。]]&lt;br /&gt;
&lt;br /&gt;
An example of data produced by data dredging through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence.&lt;br /&gt;
&lt;br /&gt;
一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be [[Reproducibility|reproduced]] on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper [[statistical hypothesis testing]]. A simple version of this problem in [[machine learning]] is known as [[overfitting]], but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&amp;lt;ref name=hawkins&amp;gt;{{cite journal | last1 = Hawkins | first1 = Douglas M | year = 2004 | title = The problem of overfitting | url = | journal = Journal of Chemical Information and Computer Sciences | volume = 44 | issue = 1| pages = 1–12 | doi=10.1021/ci0342472| pmid = 14741005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be reproduced on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper statistical hypothesis testing. A simple version of this problem in machine learning is known as overfitting, but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&lt;br /&gt;
&lt;br /&gt;
数据挖掘可能会在无意中被误用，然后产生看似重要的结果; 但这些结果实际上并不能用来预测未来的行为，也不能在新的数据样本上进行复现，而且用处不大。这通常是由于调查了太多的假设，而没有进行适当的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;统计假设检验 Statistical Hypothesis Testing&amp;lt;/font&amp;gt;'''。在机器学习中，这种问题可以被简称为'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''，但相同的问题可能会在过程的不同阶段出现，因此，在完全适用的情况下，合理进行训练/测试分割这一种方法可能不足以防止这种情况的发生。&lt;br /&gt;
&lt;br /&gt;
{{Missing information|section|non-classification tasks in data mining. It only covers [[machine learning]]|date=September 2011}}&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called [[overfitting]]. To overcome this, the evaluation uses a [[test set]] of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a [[training set]] of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had ''not'' been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as [[Receiver operating characteristic|ROC curves]].&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called overfitting. To overcome this, the evaluation uses a test set of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a training set of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had not been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as ROC curves.&lt;br /&gt;
&lt;br /&gt;
从数据中发现知识的最后一步是验证数据挖掘算法产生的模式是否存在于更广泛的数据集中。数据挖掘算法发现的并非所有模式都是有效的，因为对于数据挖掘算法来说，在训练集中发现一般数据集中没有的模式是很常见的，这叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''。为了克服这个问题，评估使用一组测试数据，而数据挖掘算法并没有在这些测试数据上进行训练。然后将学习到的模式应用到这个'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;测试集 Test Set&amp;lt;/font&amp;gt;'''中，并将结果输出与期望的输出进行比较。例如，试图区分“垃圾邮件”和“合法”邮件的数据挖掘算法将根据一组电子邮件'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;训练集 Training Sett&amp;lt;/font&amp;gt;'''样本进行训练。训练完毕后，学到的模式将应用于未经训练的那部分电子邮件测试集数据上。然后，可以从这些模式正确分类的电子邮件数量来衡量这些模式的准确性。可以使用几种统计方法可以用来评估算法，如'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;ROC 曲线 ROC curves&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
如果学习的模式不能达到预期的标准，那么就需要重新评估和修改预处理和数据挖掘的步骤。如果所学的模式确实符合所需的标准，那么最后一步就是对习得的模式进行解释并将其转化为知识。&lt;br /&gt;
&lt;br /&gt;
==研究 Research==&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the [[Association for Computing Machinery]]'s (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining ([[SIGKDD]]).&amp;lt;ref&amp;gt;{{cite web|url=http://academic.research.microsoft.com/?SearchDomain=2&amp;amp;SubDomain=7&amp;amp;entitytype=2|title=Microsoft Academic Search: Top conferences in data mining | publisher=[[Microsoft Academic Search]]}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|url=https://scholar.google.de/citations?view_op=top_venues&amp;amp;hl=en&amp;amp;vq=eng_datamininganalysis|title=Google Scholar: Top publications - Data Mining &amp;amp; Analysis|publisher=[[Google Scholar]]}}&amp;lt;/ref&amp;gt; Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings,&amp;lt;ref&amp;gt;[http://www.kdd.org/conferences.php Proceedings] {{Webarchive|url=https://web.archive.org/web/20100430120252/http://www.kdd.org/conferences.php |date=2010-04-30 }}, International Conferences on Knowledge Discovery and Data Mining, ACM, New York.&amp;lt;/ref&amp;gt; and since 1999 it has published a biannual [[academic journal]] titled &amp;quot;SIGKDD Explorations&amp;quot;.&amp;lt;ref&amp;gt;[http://www.kdd.org/explorations/about.php SIGKDD Explorations], ACM, New York.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the Association for Computing Machinery's (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining (SIGKDD). Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings, and since 1999 it has published a biannual academic journal titled &amp;quot;SIGKDD Explorations&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
该领域的首要专业机构是计算机协会 ACM的知识发现和数据挖掘特别兴趣小组 SIGKDD。自1989年以来，ACM SIG每年举办一次国际会议并出版会议记录，自1999年起，它还出版了一份名为“SIGKDD探索”的两年期学术期刊。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
关于数据挖掘的计算机科学会议包括:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[CIKM Conference]] – ACM [[Conference on Information and Knowledge Management]]&lt;br /&gt;
&lt;br /&gt;
CIKM会议 ：ACM'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;信息和知识管理会议 Conference on Information and Knowledge Management&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
* [[European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases]]&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;欧洲机器学习与数据库知识发现原理与实践会议 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
* [[KDD Conference]] – ACM SIGKDD [[Conference on Knowledge Discovery and Data Mining]]&lt;br /&gt;
&lt;br /&gt;
KDD会议：ACM SIGKDD的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;知识发现与数据挖掘会议 Conference on Knowledge Discovery and Data Mining&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many [[List of computer science conferences#Data Management|data management/database conferences]] such as the ICDE Conference, [[SIGMOD|SIGMOD Conference]] and [[International Conference on Very Large Data Bases]]&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many data management/database conferences such as the ICDE Conference, SIGMOD Conference and International Conference on Very Large Data Bases.&lt;br /&gt;
&lt;br /&gt;
数据挖掘专题也出现在许多数据管理/数据库会议上，如 ICDE会议、 '''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;SIGMOD会议 SIGMOD Conference&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关于超大数据库国际会议International Conference on Very Large Data Bases&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
==标准 Standards==&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European [[Cross Industry Standard Process for Data Mining]] (CRISP-DM 1.0) and the 2004 [[Java Data Mining]] standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European Cross Industry Standard Process for Data Mining (CRISP-DM 1.0) and the 2004 Java Data Mining standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
为数据挖掘过程定义了一些标准，例如1999年欧洲跨行业数据挖掘标准流程（CRISP-DM 1.0）和2004年Java数据挖掘标准（JDM 1.0）。这些程序的后续程序（CRISP-DM 2.0和 JDM 2.0）的开发活跃于2006年，但此后一直停滞不前。Jdm 2.0没有达成最终草案就被撤销了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in [[predictive analytics]]&amp;amp;nbsp;– the key standard is the [[Predictive Model Markup Language]] (PMML), which is an [[XML]]-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) [[subspace clustering]] have been proposed independently of the DMG.&amp;lt;ref&amp;gt;{{Cite book | last1 = Günnemann | first1 = Stephan | last2 = Kremer | first2 = Hardy | last3 = Seidl | first3 = Thomas | doi = 10.1145/2023598.2023605 | chapter = An extension of the PMML standard to subspace clustering models | title = Proceedings of the 2011 workshop on Predictive markup language modeling - PMML '11 | pages = 48 | year = 2011 | isbn = 978-1-4503-0837-3 | pmid =  | pmc = }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in predictive analytics&amp;amp;nbsp;– the key standard is the Predictive Model Markup Language (PMML), which is an XML-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) subspace clustering have been proposed independently of the DMG.&lt;br /&gt;
&lt;br /&gt;
为了交换所提取的模型，特别是在预测分析中使用，关键的标准是预测模型标记语言 PMML，这是一种基于 XML 的语言，由数据挖掘集团 DMG 开发，并支持作为交换格式的许多数据挖掘应用程序。顾名思义，它只涵盖预测模型，这是一项对业务应用程序非常重要的特殊数据挖掘任务。然而，覆盖子空间聚类的扩展已经独立于 DMG 被提出。&lt;br /&gt;
&lt;br /&gt;
==显著用途 Notable uses==&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable [[examples of data mining]] can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable examples of data mining can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
数据挖掘在任何有数字数据可用的地方都可以被使用。数据挖掘的著名例子可以在商业、医学、科学和监控领域找到。&lt;br /&gt;
&lt;br /&gt;
==隐私问题和道德规范 Privacy concerns and ethics==&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&amp;lt;ref&amp;gt;{{cite journal |author=Seltzer, William |title=The Promise and Pitfalls of Data Mining: Ethical Issues |url=https://ww2.amstat.org/committees/ethics/linksdir/Jsm2005Seltzer.pdf|publisher = American Statistical Association|journal = ASA Section on Government Statistics|date = 2005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&lt;br /&gt;
&lt;br /&gt;
虽然“数据挖掘”这个术语本身可能没有伦理含义，但它通常与人们行为（伦理和其他）相关的信息挖掘有关。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding [[privacy]], legality, and ethics.&amp;lt;ref&amp;gt;{{cite journal |author=Pitts, Chip |title=The End of Illegal Domestic Spying? Don't Count on It |url=http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |journal=Washington Spectator |date=15 March 2007 |url-status=dead |archiveurl=https://web.archive.org/web/20071128015201/http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |archivedate=2007-11-28 }}&amp;lt;/ref&amp;gt; In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the [[Total Information Awareness]] Program or in [[ADVISE]], has raised privacy concerns.&amp;lt;ref&amp;gt;{{cite journal |author=Taipale, Kim A. |title=Data Mining and Domestic Security: Connecting the Dots to Make Sense of Data |url=http://www.stlr.org/cite.cgi?volume=5&amp;amp;article=2 |journal=Columbia Science and Technology Law Review |volume=5 |issue=2 |date=15 December 2003 |ssrn=546782 |oclc=45263753 }}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|last1=Resig|first1=John|title=A Framework for Mining Instant Messaging Services|url=https://johnresig.com/files/research/SIAMPaper.pdf|accessdate=16 March 2018}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding privacy, legality, and ethics. In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the Total Information Awareness Program or in ADVISE, has raised privacy concerns.&lt;br /&gt;
&lt;br /&gt;
在某些情况下，数据挖掘的使用方式可能会引发隐私、合法性和伦理问题。特别是，为国家安全或执法目的而进行的政府或商业数据集的数据挖掘，如在全面信息意识项目或在 ADVISE 中，引起了隐私问题。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through [[aggregate function|data aggregation]]. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent).&amp;lt;ref name=&amp;quot;NASCIO&amp;quot;&amp;gt;[http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf ''Think Before You Dig: Privacy Implications of Data Mining &amp;amp; Aggregation''] {{webarchive|url=https://web.archive.org/web/20081217063043/http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf |date=2008-12-17 }}, NASCIO Research Brief, September 2004&amp;lt;/ref&amp;gt; This is not data mining ''per se'', but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&amp;lt;ref&amp;gt;{{cite magazine |first=Paul |last=Ohm |title=Don't Build a Database of Ruin |magazine=Harvard Business Review |url=http://blogs.hbr.org/cs/2012/08/dont_build_a_database_of_ruin.html}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/12/03/iron-cagebook/ Iron Cagebook - The Logical End of Facebook's Patents], [[Counterpunch.org]], 2013.12.03&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/09/11/inside-the-tech-industrys-startup-conference/ Inside the Tech industry's Startup Conference], [[Counterpunch.org]], 2013.09.11&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through data aggregation. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent). This is not data mining per se, but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&lt;br /&gt;
&lt;br /&gt;
数据挖掘需要进行数据准备，以发现损害机密性和隐私义务的信息或模式。实现这一点的一种常见方式是通过'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据聚合 Data Aggregation&amp;lt;/font&amp;gt;'''。数据聚合包括以一种便于分析的方式将数据（可能来自不同的来源）组合在一起（但这也可能使私人、个人级别的数据的识别变得可推断或以其他方式显而易见）。但这并不是数据挖掘本身，而是在分析之前以及为分析目的准备数据的结果。当数据被编译后，数据挖掘者或任何有权访问新编译的数据集的人能够识别特定的个人，特别是当数据最初是匿名的时，对个人隐私的威胁就开始发挥作用了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It is recommended{{whom|date=August 2019}} to be aware of the following '''before''' data are collected:&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
It is recommended to be aware of the following before data are collected:&lt;br /&gt;
&lt;br /&gt;
在收集数据之前，建议注意以下事项:&lt;br /&gt;
&lt;br /&gt;
* The purpose of the data collection and any (known) data mining projects;&lt;br /&gt;
&lt;br /&gt;
数据收集和任何（已知的）数据挖掘项目的目的；&lt;br /&gt;
&lt;br /&gt;
* How the data will be used;&lt;br /&gt;
&lt;br /&gt;
数据使用的方法；&lt;br /&gt;
&lt;br /&gt;
* Who will be able to mine the data and use the data and their derivatives;&lt;br /&gt;
&lt;br /&gt;
谁将能够挖掘数据并使用这些数据及其衍生工具；&lt;br /&gt;
&lt;br /&gt;
* The status of security surrounding access to the data;&lt;br /&gt;
&lt;br /&gt;
数据访问的安全状态；&lt;br /&gt;
&lt;br /&gt;
* How collected data can be updated.&lt;br /&gt;
&lt;br /&gt;
如何更新收集的数据。&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to ''become'' anonymous, so that individuals may not readily be identified.&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt; However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&amp;lt;ref&amp;gt;[http://www.securityfocus.com/brief/277 ''AOL search data identified individuals''], SecurityFocus, August 2006&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to become anonymous, so that individuals may not readily be identified.However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&lt;br /&gt;
&lt;br /&gt;
数据也可以被修改成匿名的，这样个人就不容易被修改了确定。但是，甚至“匿名化”的数据集也可能包含足够的信息用来识别个人，就像记者能够根据一组无意中搜索历史找到几个个人一样美国在线发布。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of [[personally identifiable information]] leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of [[privacy violation]], the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&amp;lt;ref&amp;gt;{{Cite journal|title = Big data׳s impact on privacy, security and consumer welfare|journal = Telecommunications Policy|pages = 1134–1145|volume = 38|issue = 11|doi = 10.1016/j.telpol.2014.10.002|first = Nir|last = Kshetri|year = 2014|url = http://libres.uncg.edu/ir/uncg/f/N_Kshetri_Big_2014.pdf}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of personally identifiable information leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of privacy violation, the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
无意中泄露个人身份信息导致提供者违反了公平信息惯例。这种轻率的行为会对指定的个人造成经济、情感或身体伤害。在一起侵犯隐私的案例中，沃尔格林 Walgreens的赞助人在2011年对该公司提起诉讼，指控该公司向数据挖掘公司出售处方信息，而数据挖掘公司又将这些数据提供给制药公司。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲的情况 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[European Union|Europe]] has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the [[International Safe Harbor Privacy Principles|U.S.-E.U. Safe Harbor Principles]], developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of [[Edward Snowden]]'s [[global surveillance disclosure]], there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the [[National Security Agency]], and attempts to reach an agreement with the United States have failed.&amp;lt;ref&amp;gt;{{cite web |url=https://crsreports.congress.gov/product/pdf/R/R44257/7 |title=U.S.-E.U. Data Privacy: From Safe Harbor to Privacy Shield |last1=Weiss |first1=Martin A. |last2=Archick |first2=Kristin |date=19 May 2016 |department= |website= |series= |agency=Congressional Research Service |location=Washington, D.C. |page=6 |pages= |format=PDF |id=R44257 |access-date=9 April 2020 |quote=On October 6, 2015, the [[Court of Justice of the European Union|CJEU]]&amp;amp;nbsp;... issued a decision that invalidated Safe Harbor (effective immediately), as currently implemented. }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Europe has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the U.S.-E.U. Safe Harbor Principles, developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of Edward Snowden's global surveillance disclosure, there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the National Security Agency, and attempts to reach an agreement with the United States have failed.&lt;br /&gt;
&lt;br /&gt;
欧洲有相当强的隐私法，正在努力进一步加强消费者的权利。然而，1998年至2000年期间制定的《美国-欧盟安全港原则》（U.S.-E.U.Safe Harbor Principles）目前有效地使欧洲用户受到美国公司的隐私剥削。由于爱德华·斯诺登 Edward Snowden披露了全球监控信息后，关于撤销这一协议的讨论越来越多，尤其是数据将完全暴露给国家安全局，与美国达成协议的尝试也失败了。&lt;br /&gt;
&lt;br /&gt;
===美国的情况 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the [[US Congress]] via the passage of regulatory controls such as the [[Health Insurance Portability and Accountability Act]] (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in ''Biotech Business Week'', &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot;&amp;lt;ref&amp;gt;Biotech Business Week Editors (June 30, 2008); ''BIOMEDICINE; HIPAA Privacy Rule Impedes Biomedical Research'', Biotech Business Week, retrieved 17 November 2009 from LexisNexis Academic&amp;lt;/ref&amp;gt; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the US Congress via the passage of regulatory controls such as the Health Insurance Portability and Accountability Act (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in Biotech Business Week, &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
在美国，美国国会通过了《健康保险便携性和责任法案》（HIPAA）等监管措施，解决了隐私问题。HIPAA要求个人就其提供的信息及其当前和未来的预期用途给予“知情同意”。根据《生物技术商业周刊》的一篇文章，“在实践中，HIPAA可能不会比研究领域长期存在的法规提供更大的保护。”。更重要的是，该规则通过知情同意进行保护的目标是接近普通个人的不可理解程度。”这突出了数据聚合和挖掘实践中数据匿名的必要性。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the [[Family Educational Rights and Privacy Act]] (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the Family Educational Rights and Privacy Act (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
美国信息隐私立法，如 HIPAA 和《家庭教育权利和隐私法》（FERPA）仅适用于每一个此类法律所涉及的特定领域。美国大多数企业对数据挖掘的使用并不受任何法律的控制。&lt;br /&gt;
&lt;br /&gt;
== 数据挖掘与著作权法 Copyright law==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Under [[Copyright law of the European Union|European copyright]] and [[Database Directive|database law]]s, the mining of in-copyright works (such as by [[web mining]]) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright{{snd}} but database rights may exist so data mining becomes subject to [[intellectual property]] owners' rights that are protected by the [[Database Directive]]. On the recommendation of the [[Hargreaves review]], this led to the UK government to amend its copyright law in 2014 to allow content mining as a [[Limitations and exceptions to copyright|limitation and exception]].&amp;lt;ref&amp;gt;[http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ UK Researchers Given Data Mining Right Under New UK Copyright Laws.] {{webarchive |url=https://web.archive.org/web/20140609020315/http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ |date=June 9, 2014 }} ''Out-Law.com.''   Retrieved 14 November 2014&amp;lt;/ref&amp;gt; The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the [[Information Society Directive]] (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
Under European copyright and database laws, the mining of in-copyright works (such as by web mining) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright but database rights may exist so data mining becomes subject to intellectual property owners' rights that are protected by the Database Directive. On the recommendation of the Hargreaves review, this led to the UK government to amend its copyright law in 2014 to allow content mining as a limitation and exception. The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the Information Society Directive (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
根据欧洲版权法和数据库法，未经版权所有人许可而对版权作品进行挖掘（如通过网络挖掘）是不合法的。在欧洲，如果数据库是纯数据，可能没有版权，但数据库权利可能存在，因此数据挖掘受数据库指令保护的知识产权所有者的权利约束。根据《哈格里夫斯评论》（Hargreaves review）的建议，这导致英国政府在2014年修订了版权法，允许将内容挖掘作为一种限制和例外。英国是继日本之后世界上第二个这样做的国家，日本在2009年引入了数据挖掘的例外。然而，由于信息社会指令（2001年）的限制，英国是例外情况但是只允许非商业目的的内容挖掘。英国版权法也不允许合同条款和条件推翻这一规定。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The [[European Commission]] facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe.&amp;lt;ref&amp;gt;{{cite web|title=Licences for Europe - Structured Stakeholder Dialogue 2013|url=http://ec.europa.eu/licences-for-europe-dialogue/en/content/about-site|website=European Commission|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt; The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and [[open access]] publishers to leave the stakeholder dialogue in May 2013.&amp;lt;ref&amp;gt;{{cite web|title=Text and Data Mining:Its importance and the need for change in Europe|url=http://libereurope.eu/news/text-and-data-mining-its-importance-and-the-need-for-change-in-europe/|website=Association of European Research Libraries|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The European Commission facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe. The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and open access publishers to leave the stakeholder dialogue in May 2013.&lt;br /&gt;
&lt;br /&gt;
2013年，欧盟委员会以“欧洲许可证”为题，推动了利益相关者对文本和数据挖掘的讨论。但他们将重点放在解决这一法律问题上，如许可证而不是限制和例外，导致大学、研究人员、图书馆、民间社会团体和开放获取出版商的代表于2013年5月离开了利益相关者对话。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===美国 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Copyright law of the United States|US copyright law]], and in particular its provision for [[fair use]], upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the [[Google Book Search Settlement Agreement|Google Book settlement]] the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&amp;lt;ref&amp;gt;{{cite web|title=Judge grants summary judgment in favor of Google Books — a fair use victory|url=http://www.lexology.com/library/detail.aspx?g=a18c5b92-5a20-4d1d-a098-a3095046a88e|website=Lexology.com|publisher=Antonelli Law Ltd|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
US copyright law, and in particular its provision for fair use, upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the Google Book settlement the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&lt;br /&gt;
&lt;br /&gt;
美国版权法，特别是其中关于合理使用的条款，支持在美国和其他合理使用国家，如以色列，台湾和韩国采矿内容的合法性。由于内容挖掘是变革性的，也就是说，它不会取代原来的工作，它被视为合法的合理使用。例如，作为谷歌图书和解协议的一部分，此案的主审法官裁定，谷歌版权图书数字化项目是合法的，部分原因在于数字化项目所展示的变革性用途——其中之一就是文本和数据挖掘。&lt;br /&gt;
&lt;br /&gt;
==软件 Software==&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Data mining and machine learning software}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===开源的数据挖掘软件 Free open-source data mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以使用免费 / 开源许可证。应用程序源代码也是对公众开放访问的。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Carrot2]]: Text and search results clustering framework.  文本和搜索结果聚类框架。&lt;br /&gt;
&lt;br /&gt;
* [[Chemicalize.org]]: A chemical structure miner and web search engine.  化学结构挖掘与网络搜索引擎。&lt;br /&gt;
&lt;br /&gt;
* [[ELKI]]: A university research project with advanced [[cluster analysis]] and [[anomaly detection|outlier detection]] methods written in the [[Java (programming language)|Java]] language.  一个大学研究项目，用Java语言编写高级聚类分析和离群点检测方法。&lt;br /&gt;
&lt;br /&gt;
* [[General Architecture for Text Engineering|GATE]]: a [[natural language processing]] and language engineering tool.  一个自然语言处理和语言工程工具。&lt;br /&gt;
&lt;br /&gt;
* [[KNIME]]: The Konstanz Information Miner, a user-friendly and comprehensive data analytics framework.  Konstanz Information Miner，一个用户友好的综合数据分析框架。&lt;br /&gt;
&lt;br /&gt;
* [[MOA (Massive Online Analysis)|Massive Online Analysis (MOA)]]: a real-time big data stream mining with concept drift tool in the [[Java (programming language)|Java]] programming language.  利用Java语言中的概念漂移工具进行实时大数据流挖掘。&lt;br /&gt;
&lt;br /&gt;
* [[Multi expression programming|MEPX]] - cross-platform tool for regression and classification problems based on a Genetic Programming variant.  基于遗传编程变量的回归和分类问题的跨平台工具。&lt;br /&gt;
&lt;br /&gt;
* ML-Flex: A software package that enables users to integrate with third-party machine-learning packages written in any programming language, execute classification analyses in parallel across multiple computing nodes, and produce HTML reports of classification results.  一种软件包，使用户能够与用任何编程语言编写的第三方机器学习包集成，跨多个计算节点并行执行分类分析，并生成分类结果的HTML报告。&lt;br /&gt;
&lt;br /&gt;
* [[mlpack]]: a collection of ready-to-use machine learning algorithms written in the [[C++]] language. 一个用C++语言编写的机器学习算法的集合。&lt;br /&gt;
&lt;br /&gt;
* [[NLTK]] ([[Natural Language Toolkit]]): A suite of libraries and programs for symbolic and statistical natural language processing (NLP) for the [[Python (programming language)|Python]] language.  一套用于Python语言的符号和统计自然语言处理（NLP）的库和程序。&lt;br /&gt;
&lt;br /&gt;
* [[OpenNN]]: Open [[neural networks]] library.  开源的神经网络库。&lt;br /&gt;
&lt;br /&gt;
* [[Orange (software)|Orange]]: A component-based data mining and [[machine learning]] software suite written in the [[Python (programming language)|Python]] language. 一个用Python语言编写的基于组件的数据挖掘和机器学习软件套件。&lt;br /&gt;
&lt;br /&gt;
* [[R (programming language)|R]]: A [[programming language]] and software environment for [[statistics|statistical]] computing, data mining, and graphics. It is part of the [[GNU Project]]. 一种用于统计计算、数据挖掘和图形的编程语言和软件环境。它是GNU项目的一部分。&lt;br /&gt;
&lt;br /&gt;
* [[scikit-learn]] is an open-source machine learning library for the Python programming language  是Python编程语言的一个开源机器学习库&lt;br /&gt;
&lt;br /&gt;
* [[Torch (machine learning)|Torch]]: An [[open source model|open-source]] [[deep learning]] library for the [[Lua (programming language)|Lua]] programming language and [[scientific computing]] framework with wide support for [[machine learning]] algorithms.  一个开源的深度学习lib库语言和科学计算框架，广泛支持机器学习算法。&lt;br /&gt;
&lt;br /&gt;
* [[UIMA]]: The UIMA (Unstructured Information Management Architecture) is a component framework for analyzing unstructured content such as text, audio and video – originally developed by IBM.  UIMA（非结构化信息管理体系结构）是一个用于分析非结构化内容（如文本、音频和视频）的组件框架，最初由IBM开发。&lt;br /&gt;
&lt;br /&gt;
* [[Weka (machine learning)|Weka]]: A suite of machine learning software applications written in the [[Java (programming language)|Java]] programming language.  用Java编程语言编写的一套机器学习软件应用程序。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===需要专有许可的数据挖掘软件和应用程序 Proprietary data-mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以根据专有许可证提供。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Angoss]] KnowledgeSTUDIO: data mining tool  数据挖掘工具。&lt;br /&gt;
&lt;br /&gt;
* [[LIONsolver]]: an integrated software application for data mining, business intelligence, and modeling that implements the Learning and Intelligent OptimizatioN (LION) approach.  用于数据挖掘、商业智能和建模的集成软件应用程序，实现学习和智能优化（LION）方法。&lt;br /&gt;
&lt;br /&gt;
* Megaputer Intelligence: data and text mining software is called PolyAnalyst.  数据和文本挖掘软件PolyAnalyst。&lt;br /&gt;
&lt;br /&gt;
* [[Microsoft Analysis Services]]: data mining software provided by [[Microsoft]].  微软提供的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[NetOwl]]: suite of multilingual text and entity analytics products that enable data mining.  支持数据挖掘的多语言文本和实体分析产品套件。&lt;br /&gt;
&lt;br /&gt;
* [[Oracle Data Mining]]: data mining software by [[Oracle Corporation]].  Oracle公司的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[PSeven]]: platform for automation of engineering simulation and analysis, multidisciplinary optimization and data mining provided by [[DATADVANCE]].  DATADVANCE为工程仿真分析、多学科优化和数据挖掘提供自动化平台。&lt;br /&gt;
&lt;br /&gt;
* [[Qlucore]] Omics Explorer: data mining software.  数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[RapidMiner]]: An environment for [[machine learning]] and data mining experiments. &amp;lt;!-- Latest version is NOT opensource --&amp;gt;  一个用于机器学习和数据挖掘实验的环境。&lt;br /&gt;
&lt;br /&gt;
* [[SAS (software)#Components|SAS Enterprise Miner]]: data mining software provided by the [[SAS Institute]].  SAS机构提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[SPSS Modeler]]: data mining software provided by [[IBM]].  IBM提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[STATISTICA]] Data Miner: data mining software provided by [[StatSoft]].  StatSoft提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[Tanagra (machine learning)|Tanagra]]: Visualisation-oriented data mining software, also for teaching.  面向可视化的数据挖掘软件，也用于教学。&lt;br /&gt;
&lt;br /&gt;
* [[Vertica]]: data mining software provided by [[Hewlett-Packard]].  惠普提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
==扩展链接 See also==&lt;br /&gt;
&lt;br /&gt;
; Methods&lt;br /&gt;
&lt;br /&gt;
方法&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Agent mining]]  主体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection|Anomaly/outlier/change detection]]  异常/异常/变化检测&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]]  关联规则学习&lt;br /&gt;
&lt;br /&gt;
* [[Bayesian network]]s  贝叶斯网络&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]]  分类&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis]]  聚类分析&lt;br /&gt;
&lt;br /&gt;
* [[Decision tree]]s  决策树&lt;br /&gt;
&lt;br /&gt;
* [[Ensemble learning]]  集成学习&lt;br /&gt;
&lt;br /&gt;
* [[Factor analysis]]  因子分析&lt;br /&gt;
&lt;br /&gt;
* [[Genetic algorithms]]  遗传算法&lt;br /&gt;
&lt;br /&gt;
* [[Intention mining]]  意向玩具&lt;br /&gt;
&lt;br /&gt;
* [[Learning classifier system]]  学习分类器系统&lt;br /&gt;
&lt;br /&gt;
* [[Multilinear subspace learning]]  多线性子空间学习&lt;br /&gt;
&lt;br /&gt;
* [[Artificial neural network|Neural network]]s  神经网络&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis]]  回归分析&lt;br /&gt;
&lt;br /&gt;
* [[Sequence mining]]   序列挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Structured data analysis (statistics)|Structured data analysis]]  结构数据学习&lt;br /&gt;
&lt;br /&gt;
* [[Support vector machines]]  支持向量机&lt;br /&gt;
&lt;br /&gt;
* [[Text mining]]  文本挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Time series|Time series analysis]]  时间序列分析&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application domains&lt;br /&gt;
&lt;br /&gt;
应用领域&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Analytics]] 分析&lt;br /&gt;
&lt;br /&gt;
* [[Behavior informatics]]  行为信息学&lt;br /&gt;
&lt;br /&gt;
* [[Big Data|Big data]]  大数据&lt;br /&gt;
&lt;br /&gt;
* [[Bioinformatics]]  生物信息学&lt;br /&gt;
&lt;br /&gt;
* [[Business intelligence]]  商务智能&lt;br /&gt;
&lt;br /&gt;
* [[Data analysis]]  数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Data warehouse]]  数据仓库&lt;br /&gt;
&lt;br /&gt;
* [[Decision support system]]  决策支持系统&lt;br /&gt;
&lt;br /&gt;
* [[Domain driven data mining]]  域驱动的数据挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Drug discovery]]  药物发现&lt;br /&gt;
&lt;br /&gt;
* [[Exploratory data analysis]]  探索性数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Predictive analytics]]  预测分析&lt;br /&gt;
&lt;br /&gt;
* [[Web mining]]  网页挖掘&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application examples&lt;br /&gt;
&lt;br /&gt;
应用示例&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|=&lt;br /&gt;
&lt;br /&gt;
*[[Automatic number plate recognition in the United Kingdom#Data mining|Automatic number plate recognition in the United Kingdom]]  英国的自动车牌识别&lt;br /&gt;
&lt;br /&gt;
*[[Customer analytics#Data mining|Customer analytics]]  客户分析&lt;br /&gt;
&lt;br /&gt;
*[[Educational data mining]]  教育数据挖掘&lt;br /&gt;
&lt;br /&gt;
*[[National Security Agency#Transaction data mining|National Security Agency]]  国家安全局&lt;br /&gt;
&lt;br /&gt;
*[[Quantitative structure–activity relationship#Data mining approach|Quantitative structure–activity relationship]]  数量结构-活动关系&lt;br /&gt;
&lt;br /&gt;
*[[Surveillance#Data mining and profiling|Surveillance]] / [[Mass surveillance#Data mining|Mass surveillance]] (e.g., [[Stellar Wind (code name)|Stellar Wind]])&lt;br /&gt;
监控/大规模监测（例如，恒星风）&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Related topics&lt;br /&gt;
&lt;br /&gt;
相关话题&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to ''analyzing'' data) , see:&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to analyzing data) , see:&lt;br /&gt;
&lt;br /&gt;
有关从数据中提取信息(与分析数据相反)的详细信息，请参阅:&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Data integration]]  数据集成&lt;br /&gt;
&lt;br /&gt;
* [[Data transformation]]  数据转换&lt;br /&gt;
&lt;br /&gt;
* [[Electronic discovery]]  电子发现&lt;br /&gt;
&lt;br /&gt;
* [[Information extraction]]  信息提取&lt;br /&gt;
&lt;br /&gt;
* [[Information integration]]  信息集成&lt;br /&gt;
&lt;br /&gt;
* [[Named-entity recognition]]  命名实体识别&lt;br /&gt;
&lt;br /&gt;
* [[Profiling (information science)]]  分析（信息科学）&lt;br /&gt;
&lt;br /&gt;
* [[Psychometrics]]  心理测量学&lt;br /&gt;
&lt;br /&gt;
* [[Social media mining]]  社交媒体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Surveillance capitalism]]  资本监视&lt;br /&gt;
&lt;br /&gt;
* [[Web scraping]]  网页抓取&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
;Other resources&lt;br /&gt;
&lt;br /&gt;
Other resources&lt;br /&gt;
&lt;br /&gt;
其他资源&lt;br /&gt;
&lt;br /&gt;
*[[International Journal of Data Warehousing and Mining]]  国际数据仓库与挖掘杂志&lt;br /&gt;
&lt;br /&gt;
==参考文献 References==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|30em}}&lt;br /&gt;
&lt;br /&gt;
==进一步阅读 Further reading==&lt;br /&gt;
&lt;br /&gt;
{{div col|colwidth=30em}}&lt;br /&gt;
&lt;br /&gt;
* Cabena, Peter; Hadjnian, Pablo; Stadler, Rolf; Verhees, Jaap; Zanasi, Alessandro (1997); ''Discovering Data Mining: From Concept to Implementation'', [[Prentice Hall]], {{ISBN|0-13-743980-6}}&lt;br /&gt;
&lt;br /&gt;
* M.S. Chen, J. Han, [[Philip S. Yu|P.S. Yu]] (1996) &amp;quot;[http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/chen_tkde96.pdf Data mining: an overview from a database perspective]&amp;quot;. ''Knowledge and data Engineering, IEEE Transactions'' on 8 (6), 866–883&lt;br /&gt;
&lt;br /&gt;
* Feldman, Ronen; Sanger, James (2007); ''The Text Mining Handbook'', [[Cambridge University Press]], {{ISBN|978-0-521-83657-9}}&lt;br /&gt;
&lt;br /&gt;
* Guo, Yike; and Grossman, Robert (editors) (1999); ''High Performance Data Mining: Scaling Algorithms, Applications and Systems'', [[Kluwer Academic Publishers]]&lt;br /&gt;
&lt;br /&gt;
* [[Jiawei Han|Han, Jiawei]], Micheline Kamber, and Jian Pei. ''Data mining: concepts and techniques''. Morgan kaufmann, 2006.&lt;br /&gt;
&lt;br /&gt;
* [[Trevor Hastie|Hastie, Trevor]], [[Robert Tibshirani|Tibshirani, Robert]] and [[Jerome H. Friedman|Friedman, Jerome]] (2001); ''The Elements of Statistical Learning: Data Mining, Inference, and Prediction'', Springer, {{ISBN|0-387-95284-5}}&lt;br /&gt;
&lt;br /&gt;
* [[Bing Liu (computer scientist)|Liu, Bing]] (2007, 2011); ''Web Data Mining: Exploring Hyperlinks, Contents and Usage Data'', [[Springer Verlag|Springer]], {{ISBN|3-540-37881-2}}&lt;br /&gt;
&lt;br /&gt;
* {{cite journal |last=Murphy |first=Chris |date=16 May 2011 |title=Is Data Mining Free Speech? |journal=[[InformationWeek]] |page=12 }}&lt;br /&gt;
&lt;br /&gt;
* Nisbet, Robert; Elder, John; Miner, Gary (2009); ''Handbook of Statistical Analysis &amp;amp; Data Mining Applications'', [[Academic Press]]/Elsevier, {{ISBN|978-0-12-374765-5}}&lt;br /&gt;
&lt;br /&gt;
* Poncelet, Pascal; Masseglia, Florent; and Teisseire, Maguelonne (editors) (October 2007); &amp;quot;Data Mining Patterns: New Methods and Applications&amp;quot;, ''Information Science Reference'', {{ISBN|978-1-59904-162-9}}&lt;br /&gt;
&lt;br /&gt;
* Tan, Pang-Ning; Steinbach, Michael; and Kumar, Vipin (2005); ''Introduction to Data Mining'', {{ISBN|0-321-32136-7}}&lt;br /&gt;
&lt;br /&gt;
* Theodoridis, Sergios; and Koutroumbas, Konstantinos (2009); ''Pattern Recognition'', 4th Edition, Academic Press, {{ISBN|978-1-59749-272-0}}&lt;br /&gt;
&lt;br /&gt;
* Weiss, Sholom M.; and Indurkhya, Nitin (1998); ''Predictive Data Mining'', [[Morgan Kaufmann]]&lt;br /&gt;
&lt;br /&gt;
* {{cite book |author1=Witten, Ian H.|authorlink1=Ian H. Witten |author2=Frank, Eibe |author3=Hall, Mark A. |title=Data Mining: Practical Machine Learning Tools and Techniques |edition=3 |date=30 January 2011 |publisher=Elsevier |isbn=978-0-12-374856-0 }} (See also [[Weka (machine learning)|Free Weka software]])&lt;br /&gt;
&lt;br /&gt;
* Ye, Nong (2003); ''The Handbook of Data Mining'', Mahwah, NJ: Lawrence Erlbaum&lt;br /&gt;
&lt;br /&gt;
{{div col end}}&lt;br /&gt;
&lt;br /&gt;
==相关链接External links==&lt;br /&gt;
&lt;br /&gt;
{{Commons category|Data mining}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Reference/Knowledge_Management/Knowledge_Discovery/Software|Knowledge Discovery Software}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Computers/Software/Databases/Data_Mining/Tool_Vendors|Data Mining Tool Vendors}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{data}}&lt;br /&gt;
&lt;br /&gt;
{{Data warehouse}}&lt;br /&gt;
&lt;br /&gt;
{{Computer science}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{Authority control}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{DEFAULTSORT:Data Mining}}&lt;br /&gt;
&lt;br /&gt;
[[Category:Data mining| ]]&lt;br /&gt;
&lt;br /&gt;
[[Category:Formal sciences]]&lt;br /&gt;
&lt;br /&gt;
Category:Formal sciences&lt;br /&gt;
&lt;br /&gt;
类别: 正规科学&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Data mining]]. Its edit history can be viewed at [[数据挖掘/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13898</id>
		<title>数据挖掘</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13898"/>
		<updated>2020-09-11T04:56:09Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条由许菁翻译整理。&lt;br /&gt;
&lt;br /&gt;
{{Machine learning bar}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Data mining''' is the process of discovering patterns in large [[data set]]s involving methods at the intersection of [[machine learning]], [[statistics]], and [[database system]]s.&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; Data mining is an [[interdisciplinary]] subfield of [[computer science]] and [[statistics]] with an overall goal to extract information (with intelligent methods) from a data set and transform the information into a comprehensible structure for further use.&amp;lt;ref name=&amp;quot;acm&amp;quot;&amp;gt;{{cite web |url=http://www.kdd.org/curriculum/index.html |title=Data Mining Curriculum |publisher=[[Association for Computing Machinery|ACM]] [[SIGKDD]] |date=2006-04-30 |accessdate=2014-01-27 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;brittanica&amp;quot;&amp;gt;{{cite web |last=Clifton |first=Christopher |title=Encyclopædia Britannica: Definition of Data Mining |year=2010 |url=http://www.britannica.com/EBchecked/topic/1056150/data-mining |accessdate=2010-12-09 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;elements&amp;quot;&amp;gt;{{cite web|last1=Hastie|first1=Trevor|authorlink1=Trevor Hastie|last2=Tibshirani|first2=Robert|authorlink2=Robert Tibshirani|last3=Friedman|first3=Jerome|authorlink3=Jerome H. Friedman|title=The Elements of Statistical Learning: Data Mining, Inference, and Prediction|year=2009|url=http://www-stat.stanford.edu/~tibs/ElemStatLearn/|accessdate=2012-08-07|archive-url=https://web.archive.org/web/20091110212529/http://www-stat.stanford.edu/~tibs/ElemStatLearn/|archive-date=2009-11-10|url-status=dead}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book|last1=Han, Kamber, Pei|first1=Jaiwei, Micheline, Jian|title=Data Mining: Concepts and Techniques|date=June 9, 2011|publisher=Morgan Kaufmann|isbn=978-0-12-381479-1|edition=3rd}}&amp;lt;/ref&amp;gt; Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt; Aside from the raw analysis step, it also involves database and [[data management]] aspects, [[data pre-processing]], [[statistical model|model]] and [[Statistical inference|inference]] considerations, interestingness metrics, [[Computational complexity theory|complexity]] considerations, post-processing of discovered structures, [[Data visualization|visualization]], and [[Online algorithm|online updating]].&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; &lt;br /&gt;
&lt;br /&gt;
Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD. Aside from the raw analysis step, it also involves database and data management aspects, data pre-processing, model and inference considerations, interestingness metrics, complexity considerations, post-processing of discovered structures, visualization, and online updating. &lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘 Data Mining &amp;lt;/font&amp;gt;'''是在大型数据集中发现模式的过程，是一种涉及到机器学习、统计学和数据库系统综合使用的方法。数据挖掘是指“在数据库中发现知识(knowledge discovery in databases,KDD)”过程中的分析步骤。除了传统的分析步骤，它还涉及数据库和数据管理方面，包括数据预处理、模型和推理考虑、兴趣度量、复杂性考虑、发现结构的后处理、可视化和在线更新等内容。&lt;br /&gt;
&lt;br /&gt;
  --[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“数据挖掘是指“在数据库中知识发现KDD”的过程的分析步骤”一句中的“在数据库中知识发现KDD”处改为“在数据库中发现知识(knowledge discovery in databases,KDD)”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a [[misnomer]], because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (''mining'') of data itself.&amp;lt;ref name=&amp;quot;han-kamber&amp;quot;&amp;gt;{{cite book|title=Data mining: concepts and techniques|last1=Han|first1=Jiawei|last2=Kamber|first2=Micheline|date=2001|publisher=[[Morgan Kaufmann]]|isbn=978-1-55860-489-6|page=5|quote=Thus, data mining should have been more appropriately named &amp;quot;knowledge mining from data,&amp;quot; which is unfortunately somewhat long|authorlink1=Jiawei Han}}&amp;lt;/ref&amp;gt; It also is a [[buzzword]]&amp;lt;ref&amp;gt;[http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf OKAIRP 2005 Fall Conference, Arizona State University] {{Webarchive|url=https://web.archive.org/web/20140201170452/http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf|date=2014-02-01}}&amp;lt;/ref&amp;gt; and is frequently applied to any form of large-scale data or [[information processing]] ([[Data collection|collection]], [[information extraction|extraction]], [[Data warehouse|warehousing]], analysis, and statistics) as well as any application of [[Decision support system|computer decision support system]], including [[artificial intelligence]] (e.g., machine learning) and [[business intelligence]]. The book ''Data mining: Practical machine learning tools and techniques with Java''&amp;lt;ref name=&amp;quot;witten&amp;quot;&amp;gt;{{cite book|title=Data Mining: Practical Machine Learning Tools and Techniques|last1=Witten|first1=Ian H.|last2=Frank|first2=Eibe|last3=Hall|first3=Mark A.|date=30 January 2011|publisher=Elsevier|isbn=978-0-12-374856-0|edition=3|authorlink1=Ian H. Witten}}&amp;lt;/ref&amp;gt; (which covers mostly machine learning material) was originally to be named just ''Practical machine learning'', and the term ''data mining'' was only added for marketing reasons.&amp;lt;ref&amp;gt;{{Cite journal|author1=Bouckaert, Remco R.|author2=Frank, Eibe|author3=Hall, Mark A.|author4=Holmes, Geoffrey|author5=Pfahringer, Bernhard|author6=Reutemann, Peter|author7=Witten, Ian H.|authorlink7=Ian H. Witten|year=2010|title=WEKA Experiences with a Java open-source project|journal=Journal of Machine Learning Research|volume=11|pages=2533–2541|quote=the original title, &amp;quot;Practical machine learning&amp;quot;, was changed&amp;amp;nbsp;... The term &amp;quot;data mining&amp;quot; was [added] primarily for marketing reasons.|postscript={{inconsistent citations}}}}&amp;lt;/ref&amp;gt; Often the more general terms (''large scale'') ''[[data analysis]]'' and ''[[analytics]]'' – or, when referring to actual methods, ''artificial intelligence'' and ''machine learning'' – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a misnomer, because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (mining) of data itself. It also is a buzzword and is frequently applied to any form of large-scale data or information processing (collection, extraction, warehousing, analysis, and statistics) as well as any application of computer decision support system, including artificial intelligence (e.g., machine learning) and business intelligence. The book Data mining: Practical machine learning tools and techniques with Java (which covers mostly machine learning material) was originally to be named just Practical machine learning, and the term data mining was only added for marketing reasons. Often the more general terms (large scale) data analysis and analytics – or, when referring to actual methods, artificial intelligence and machine learning – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
“数据挖掘”这种形容其实并不十分恰当，因为我们的目标是从大量数据中提取模式和知识，而不是数据本身的提取(挖掘)。它是一个流行语，经常用于任何形式的大规模数据或信息处理（收集、提取、仓储、分析和统计）的场景下，以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 计算机决策系统 Decision Support System，DSS&amp;lt;/font&amp;gt;'''的任何应用当中，包括人工智能（例如机器学习）和商业智能。《数据挖掘：使用Java的实用机器学习工具和技术》（主要涵盖机器学习材料）一书最初被命名为“实用机器学习”，而数据挖掘一词只是为了营销的原因而增加。经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records ([[cluster analysis]]), unusual records ([[anomaly detection]]), and dependencies ([[association rule mining]], [[sequential pattern mining]]). This usually involves using database techniques such as [[spatial index|spatial indices]]. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and [[predictive analytics]]. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a [[decision support system]]. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records (cluster analysis), unusual records (anomaly detection), and dependencies (association rule mining, sequential pattern mining). This usually involves using database techniques such as spatial indices. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and predictive analytics. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a decision support system. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
实际上数据挖掘任务是对大量数据进行半自动或全自动分析，以提取出从前未知的且有趣的模式，如数据记录组(数据聚类)、异常记录组(异常检测)和依赖关系(关联规则挖掘，序列挖掘)。这通常涉及使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种汇总，并且可以用于进一步的分析，或者，例如，机器学习和预测分析。例如，数据挖掘步骤可以识别数据中的多个组，然后可以使用该步骤通过决策支持系统获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是作为附加步骤属于整个 KDD 过程。&lt;br /&gt;
&lt;br /&gt;
如数据记录组（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''）、异常记录（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly Detection&amp;lt;/font&amp;gt;'''）和依赖关系（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则挖掘 Association Rule Mining&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;序列模式挖掘 Sequential Pattern Mining&amp;lt;/font&amp;gt;'''）。这通常涉及到使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种规律总结，可以用于进一步的分析，或者，例如，在机器学习和预测分析中。例如，通过数据挖掘可以出识别数据中的多个组，然后这些组可以通过使用决策支持系统来获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是属于整个KDD过程的附加步骤。&lt;br /&gt;
&lt;br /&gt;
The difference between [[data analysis]] and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&amp;lt;ref&amp;gt;Olson, D. L. (2007). Data mining in business services. ''Service Business'', ''1''(3), 181-193. {{doi|10.1007/s11628-006-0014-7}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The difference between data analysis and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据分析 Data Analysis&amp;lt;/font&amp;gt;'''和数据挖掘的区别在于，数据分析用于测试数据集上的模型和假设，例如，分析营销活动的有效性，而不考虑数据量的多少；相反，数据挖掘使用机器学习和统计模型来发现“大量”数据中的秘密或隐藏模式。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The related terms ''[[data dredging]]'', ''data fishing'', and ''data snooping'' refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
The related terms data dredging, data fishing, and data snooping refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
相关术语'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;“数据疏浚” Data Dredging&amp;lt;/font&amp;gt;'''、“数据钓鱼”和“数据窥探”是指使用数据挖掘方法对较大的人口数据集中的一部分进行抽样，这些数据集太小（或可能太小），无法对所发现的任何模式的有效性作出可靠的统计推断。但是，这些方法可以用于提出新的假设，以针对更大的数据群体进行测试。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==起源 Etymology==&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like ''data fishing'' or ''data dredging'' to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist [[Michael Lovell]] in an article published in the ''[[Review of Economic Studies]]'' in 1983.&amp;lt;ref&amp;gt;{{Cite journal|last=Lovell|first=Michael C.|date=1983|title=Data Mining|journal=The Review of Economics and Statistics|volume=65|issue=1|pages=1–12|doi=10.2307/1924403|jstor=1924403}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book |first=Wojciech W. |last=Charemza |first2=Derek F. |last2=Deadman |title=New Directions in Econometric Practice |location=Aldershot |publisher=Edward Elgar |year=1992 |chapter=Data Mining |pages=14–31 |isbn=1-85278-461-X }}&amp;lt;/ref&amp;gt; Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like data fishing or data dredging to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist Michael Lovell in an article published in the Review of Economic Studies in 1983. Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
在20世纪60年代，统计学家和经济学家们曾经使用“数据钓鱼”或”数据疏浚“等术语来指代他们认为在没有先验假设的情况下进行数据分析的糟糕做法。经济学家迈克尔•洛弗尔 Michael Lovell 在1983年《经济研究评论》（Review of Economic Studies）上发表的一篇文章中，也以类似的批判方式使用了“数据挖掘”这个术语。Lovell 指出，这种做法“伪装成各种别名，从“实验”(正面)到“钓鱼”或“窥探”(负面)。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term ''data mining'' appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation;&amp;lt;ref name=&amp;quot;Mena&amp;quot;&amp;gt;{{cite book |last=Mena |first=Jesús |year=2011 |title=Machine Learning Forensics for Law Enforcement, Security, and Intelligence |location=Boca Raton, FL |publisher=CRC Press (Taylor &amp;amp; Francis Group) |isbn=978-1-4398-6069-4 }}&amp;lt;/ref&amp;gt; researchers consequently turned to ''data mining''. Other terms used include ''data archaeology'', ''information harvesting'', ''information discovery'', ''knowledge extraction'', etc. [[Gregory I. Piatetsky-Shapiro|Gregory Piatetsky-Shapiro]] coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic [http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] and this term became more popular in [[Artificial intelligence|AI]] and [[machine learning]] community. However, the term data mining became more popular in the business and press communities.&amp;lt;ref&amp;gt;{{cite web |last1=Piatetsky-Shapiro |first1=Gregory |authorlink1=Gregory Piatetsky-Shapiro |last2=Parker |first2=Gary |url=http://www.kdnuggets.com/data_mining_course/x1-intro-to-data-mining-notes.html |title=Lesson: Data Mining, and Knowledge Discovery: An Introduction |publisher=KD Nuggets |year=2011 |work=Introduction to Data Mining |accessdate=30 August 2012 }}&amp;lt;/ref&amp;gt; Currently, the terms ''data mining'' and ''knowledge discovery'' are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
The term data mining appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation; researchers consequently turned to data mining. Other terms used include data archaeology, information harvesting, information discovery, knowledge extraction, etc. Gregory Piatetsky-Shapiro coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic (KDD-1989) and this term became more popular in AI and machine learning community. However, the term data mining became more popular in the business and press communities. Currently, the terms data mining and knowledge discovery are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
数据挖掘这个术语在1990年左右出现在数据库领域，通常有着积极的内涵。在20世纪80年代的一段短暂时间里，人们曾使用过“数据库挖掘”这种表达，但由于这个词被总部位于圣地亚哥的 HNC 公司注册为商标，因此研究人员转向了数据挖掘。曾用过的其他术语包括数据考古学、信息收集、信息发现、知识提取等。格雷戈里·皮亚特斯基·夏皮罗 Gregory Piatetsky-Shapiro 在关于这个主题的第一个研讨会[ http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] 上首次创造了“数据库中的知识发现 Knowledge Discovery in Databases，KDD”这个术语。此后，这个术语在人工智能和机器学习社区中变得更加流行。然而，数据挖掘这个术语在商业和出版界变得越来越流行。目前，数据挖掘和知识发现 knowledge discovery这两个术语可以互换使用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery ([[KDD-95]]) was started in Montreal under [[AAAI]] sponsorship. It was co-chaired by [[Usama Fayyad]] and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called [[Data Mining and Knowledge Discovery]] as its founding editor-in-chief. Later he started the [[SIGKDD]] Newsletter SIGKDD Explorations.&amp;lt;ref name=SIGKDD-explorations&amp;gt;{{cite journal|last1=Fayyad|first1=Usama|title=First Editorial by Editor-in-Chief|journal=SIGKDD Explorations|date=15 June 1999|volume=13|issue=1|pages=102|doi=10.1145/2207243.2207269|url=http://www.kdd.org/explorations/view/june-1999-volume-1-issue-1|accessdate=27 December 2010|ref=SIGKDD-explorations}}&amp;lt;/ref&amp;gt; The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal ''Data Mining and Knowledge Discovery'' is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery (KDD-95) was started in Montreal under AAAI sponsorship. It was co-chaired by Usama Fayyad and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called Data Mining and Knowledge Discovery as its founding editor-in-chief. Later he started the SIGKDD Newsletter SIGKDD Explorations.The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal Data Mining and Knowledge Discovery is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
在学术界，主要的研究论坛始于1995年，当时，在AAAI的赞助下，第一届数据挖掘和知识发现国际会议（KDD-95）在蒙特利尔召开。会议由乌萨马·法耶兹 Usama Fayyad和拉玛萨米·乌图鲁萨米 Ramasamy Uthurusamy共同主持。一年后，1996年Usama Fayyad创办了杂志《数据挖掘与知识发现》（datamining and Knowledge Discovery），担任创始主编。后来他创办了SIGKDD时事通讯探索。那个KDD国际会议也成为了数据挖掘领域质量最高的主要会议，其研究论文提交的接受率低于18%，而《数据挖掘与知识发现》也成为了该领域的主要研究期刊。&lt;br /&gt;
&lt;br /&gt;
==背景 Background==&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from [[data]] has occurred for centuries. Early methods of identifying patterns in data include [[Bayes' theorem]] (1700s) and [[regression analysis]] (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As [[data set]]s have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as [[neural networks]], [[cluster analysis]], [[genetic algorithms]] (1950s), [[decision tree learning|decision trees]] and [[decision rules]] (1960s), and [[support vector machines]] (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns&amp;lt;ref name=&amp;quot;Kantardzic&amp;quot;&amp;gt;{{cite book |last=Kantardzic |first=Mehmed |title=Data Mining: Concepts, Models, Methods, and Algorithms |year=2003 |publisher=John Wiley &amp;amp; Sons |isbn=978-0-471-22852-3 |oclc=50055336 |url-access=registration |url=https://archive.org/details/dataminingconcep0000kant }}&amp;lt;/ref&amp;gt; in large data sets. It bridges the gap from [[applied statistics]] and artificial intelligence (which usually provide the mathematical background) to [[database management]] by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from data has occurred for centuries. Early methods of identifying patterns in data include Bayes' theorem (1700s) and regression analysis (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As data sets have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as neural networks, cluster analysis, genetic algorithms (1950s), decision trees and decision rules (1960s), and support vector machines (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns in large data sets. It bridges the gap from applied statistics and artificial intelligence (which usually provide the mathematical background) to database management by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
从数据中手动提取模式的方法已经持续了好几个世纪了。早期识别数据模式的方法包括17世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;贝叶斯定理 Bayes' Theorem&amp;lt;/font&amp;gt;'''和19世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归分析 Regression Analysis&amp;lt;/font&amp;gt;'''。计算机技术的扩散、其普遍性和日益强大的能力极大地提高了数据的收集、存储和操作能力。随着数据集的规模和复杂性的增长，手动分析数据的方法越来越多地被更强的间接、自动化的数据处理所取代，这都得益于计算机科学其他领域取得的新的进步，特别是机器学习领域的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;神经网络 Neural Networks&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;遗传算法 Genetic Algorithms&amp;lt;/font&amp;gt;'''（1950年代），'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策树 Decision Tree&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策规则 Decision Rules&amp;lt;/font&amp;gt;'''（1960年代）以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;支持向量机 Support Vector Machines&amp;lt;/font&amp;gt;'''（1990年代）等。数据挖掘就是应用这些方法来发现大型数据集中的隐藏模式的过程。它利用数据在数据库中存储和索引的方式，更有效地执行实际的学习和发现算法，从而弥补了从应用统计学和人工智能(通常提供数学背景)到数据库管理之间的差距，使这些方法能够应用于更大的数据集。&lt;br /&gt;
&lt;br /&gt;
==发展过程 Process==&lt;br /&gt;
&lt;br /&gt;
The ''knowledge discovery in databases (KDD) process'' is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
The knowledge discovery in databases (KDD) process is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
数据库中的知识发现 Knowledge Discovery in Databases ，KDD过程通常定义为以下几个阶段:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Selection&lt;br /&gt;
&lt;br /&gt;
 Selection&lt;br /&gt;
&lt;br /&gt;
选择&lt;br /&gt;
&lt;br /&gt;
# Pre-processing&lt;br /&gt;
&lt;br /&gt;
 Pre-processing&lt;br /&gt;
&lt;br /&gt;
预处理&lt;br /&gt;
&lt;br /&gt;
# Transformation&lt;br /&gt;
&lt;br /&gt;
 Transformation&lt;br /&gt;
&lt;br /&gt;
转换&lt;br /&gt;
&lt;br /&gt;
# ''Data mining''&lt;br /&gt;
&lt;br /&gt;
 Data mining&lt;br /&gt;
&lt;br /&gt;
数据挖掘&lt;br /&gt;
&lt;br /&gt;
# Interpretation/evaluation.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
 Interpretation/evaluation.&lt;br /&gt;
&lt;br /&gt;
解释 / 评估。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the [[Cross-industry standard process for data mining]] (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the Cross-industry standard process for data mining (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
然而，它存在于这个主题的许多变体中，例如在'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘的跨行业标准流程 Cross-industry standard process for data mining，CRISP-DM&amp;lt;/font&amp;gt;'''中它定义了以下六个阶段：&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Business understanding&lt;br /&gt;
&lt;br /&gt;
 Business understanding&lt;br /&gt;
&lt;br /&gt;
商业理解&lt;br /&gt;
&lt;br /&gt;
# Data understanding&lt;br /&gt;
&lt;br /&gt;
 Data understanding&lt;br /&gt;
&lt;br /&gt;
数据理解&lt;br /&gt;
&lt;br /&gt;
# Data preparation&lt;br /&gt;
&lt;br /&gt;
 Data preparation&lt;br /&gt;
&lt;br /&gt;
数据准备&lt;br /&gt;
&lt;br /&gt;
# Modeling&lt;br /&gt;
&lt;br /&gt;
 Modeling&lt;br /&gt;
&lt;br /&gt;
建模&lt;br /&gt;
&lt;br /&gt;
# Evaluation&lt;br /&gt;
&lt;br /&gt;
 Evaluation&lt;br /&gt;
&lt;br /&gt;
评估&lt;br /&gt;
&lt;br /&gt;
# Deployment&lt;br /&gt;
&lt;br /&gt;
 Deployment&lt;br /&gt;
&lt;br /&gt;
部署&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
或一个简化的过程，包括：(1)预处理，(2)数据挖掘，(3)结果验证。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners.&amp;lt;ref&amp;gt;[[Gregory Piatetsky-Shapiro]] (2002) [http://www.kdnuggets.com/polls/2002/methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2004) [http://www.kdnuggets.com/polls/2004/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2007) [http://www.kdnuggets.com/polls/2007/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2014) [http://www.kdnuggets.com/polls/2014/analytics-data-mining-data-science-methodology.html ''KDnuggets Methodology Poll'']&amp;lt;/ref&amp;gt; The only other data mining standard named in these polls was [[SEMMA]]. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models,&amp;lt;ref name=&amp;quot;kurgan&amp;quot;&amp;gt;Lukasz Kurgan and Petr Musilek (2006); [http://journals.cambridge.org/action/displayAbstract?fromPage=online&amp;amp;aid=451120 ''A survey of Knowledge Discovery and Data Mining process models'']. The Knowledge Engineering Review. Volume 21 Issue 1, March 2006, pp&amp;amp;nbsp;1–24, Cambridge University Press, New York, NY, USA {{DOI|10.1017/S0269888906000737}}&amp;lt;/ref&amp;gt; and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&amp;lt;ref name=&amp;quot;AzevedoSantos&amp;quot;&amp;gt;Azevedo, A. and Santos, M. F. [http://www.iadis.net/dl/final_uploads/200812P033.pdf KDD, SEMMA and CRISP-DM: a parallel overview] {{webarchive|url=https://web.archive.org/web/20130109114939/http://www.iadis.net/dl/final_uploads/200812P033.pdf |date=2013-01-09 }}. In Proceedings of the IADIS European Conference on Data Mining 2008, pp&amp;amp;nbsp;182–185.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners. The only other data mining standard named in these polls was SEMMA. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models, and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&lt;br /&gt;
&lt;br /&gt;
在这些调查中，唯一的其他数据挖掘标准是SEMMA。然而，使用CRISP-DM的人数是其3-4倍。一些研究小组已经发表了关于数据挖掘过程模型的研究，例如阿泽维多 Azevedo和 桑托斯Santos曾在2008年对CRISP-DM和SEMMA这两套数据挖掘流程标准进行了比较。&lt;br /&gt;
&lt;br /&gt;
===预处理 Pre-processing===&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a [[data mart]] or [[data warehouse]]. Pre-processing is essential to analyze the [[Multivariate statistics|multivariate]] data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing [[statistical noise|noise]] and those with [[missing data]].&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a data mart or data warehouse. Pre-processing is essential to analyze the multivariate data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing noise and those with missing data.&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须先对目标数据集进行整合。由于数据挖掘只能发现数据中实际存在的模式，目标数据集必须足够大以包含这些模式，同时保持足够简洁以便在可接受的时间限制内进行挖掘。数据的公共源是数据集市或数据仓库。在数据挖掘之前，对多变量数据集进行预处理是必不可少的。然后清理目标集。数据清理去除了包含噪声的观测值和缺失数据的观测值。&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须组装目标数据集。由于数据挖掘只能发现数据中实际存在的模式，因此目标数据集必须足够大以包含这些模式，同时保持足够简洁，以便在可接受的时间限制内进行挖掘。数据的常见来源是'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据集市 Data Mart&amp;lt;/font&amp;gt;'''或'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据仓库 Data Warehouse&amp;lt;/font&amp;gt;'''。在数据挖掘之前，对'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;多元 Multivariate&amp;lt;/font&amp;gt;'''数据集进行预处理是必不可少的，然后对目标集进行清洗。数据清洗将删除包含'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;噪声 Noise&amp;lt;/font&amp;gt;'''的观测值和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;缺失数据 Missing Data&amp;lt;/font&amp;gt;'''的观测值。&lt;br /&gt;
&lt;br /&gt;
===数据挖掘 Data mining===&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&amp;lt;ref name=&amp;quot;Fayyad&amp;quot;&amp;gt;{{cite web |last1=Fayyad |first1=Usama |authorlink1=Usama Fayyad |last2=Piatetsky-Shapiro |first2=Gregory|authorlink2=Gregory Piatetsky-Shapiro |last3=Smyth |first3=Padhraic |title=From Data Mining to Knowledge Discovery in Databases |year=1996 |url=http://www.kdnuggets.com/gpspubs/aimag-kdd-overview-1996-Fayyad.pdf |accessdate = 17 December 2008 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&lt;br /&gt;
&lt;br /&gt;
数据挖掘涉及六类常见的任务:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection]] (outlier/change/deviation detection) – The identification of unusual data records, that might be interesting or data errors that require further investigation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly detection&amp;lt;/font&amp;gt;'''（异常值/变化/偏差检测）：识别异常数据记录，发现可能是有趣的或需要进一步调查的数据错误。&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]] (dependency modeling) – Searches for relationships between variables. For example, a supermarket might gather data on customer purchasing habits. Using association rule learning, the supermarket can determine which products are frequently bought together and use this information for marketing purposes. This is sometimes referred to as market basket analysis.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则学习 Association rule learning&amp;lt;/font&amp;gt;'''（依赖关系建模）：探变量之间的关系。例如，超市可能会收集顾客购买习惯的数据。通过使用关联规则学习，超市可以确定哪些产品经常被一起购买，并将这些信息用于营销策略改进。这种研究有时被称为“市场篮子分析”。&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis|Clustering]] – is the task of discovering groups and structures in the data that are in some way or another &amp;quot;similar&amp;quot;, without using known structures in the data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类 Clustering&amp;lt;/font&amp;gt;'''：是指在数据中发现以某种方式或其他方式“相似”的组和结构，而不使用数据中已知的结构。&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]] – is the task of generalizing known structure to apply to new data. For example, an e-mail program might attempt to classify an e-mail as &amp;quot;legitimate&amp;quot; or as &amp;quot;spam&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;分类 Classification&amp;lt;/font&amp;gt;'''：是将已知结构归纳为新数据的任务。例如，电子邮件程序可能会尝试将电子邮件分类为“合法”或“垃圾邮件”。&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis|Regression]] – attempts to find a function that models the data with the least error that is, for estimating the relationships among data or datasets.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归&amp;lt;/font&amp;gt;'''：试图找到一个对数据建模误差最小的函数，也就是说，用于估计数据或数据集之间的关系。&lt;br /&gt;
&lt;br /&gt;
* [[Automatic summarization|Summarization]] – providing a more compact representation of the data set, including visualization and report generation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;自动文摘 Automatic summarizatio&amp;lt;/font&amp;gt;'''：提供数据集更紧凑、简洁的表示，包括可视化和报告生成。&lt;br /&gt;
&lt;br /&gt;
===结果验证 Results validation===&lt;br /&gt;
&lt;br /&gt;
[[File:Spurious correlations - spelling bee spiders.svg|thumb|An example of data produced by [[data dredging]] through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence. 一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。]]&lt;br /&gt;
&lt;br /&gt;
An example of data produced by data dredging through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence.&lt;br /&gt;
&lt;br /&gt;
一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be [[Reproducibility|reproduced]] on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper [[statistical hypothesis testing]]. A simple version of this problem in [[machine learning]] is known as [[overfitting]], but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&amp;lt;ref name=hawkins&amp;gt;{{cite journal | last1 = Hawkins | first1 = Douglas M | year = 2004 | title = The problem of overfitting | url = | journal = Journal of Chemical Information and Computer Sciences | volume = 44 | issue = 1| pages = 1–12 | doi=10.1021/ci0342472| pmid = 14741005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be reproduced on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper statistical hypothesis testing. A simple version of this problem in machine learning is known as overfitting, but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&lt;br /&gt;
&lt;br /&gt;
数据挖掘可能会在无意中被误用，然后产生看似重要的结果; 但这些结果实际上并不能用来预测未来的行为，也不能在新的数据样本上进行复现，而且用处不大。这通常是由于调查了太多的假设，而没有进行适当的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;统计假设检验 Statistical Hypothesis Testing&amp;lt;/font&amp;gt;'''。在机器学习中，这种问题可以被简称为'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''，但相同的问题可能会在过程的不同阶段出现，因此，在完全适用的情况下，合理进行训练/测试分割这一种方法可能不足以防止这种情况的发生。&lt;br /&gt;
&lt;br /&gt;
{{Missing information|section|non-classification tasks in data mining. It only covers [[machine learning]]|date=September 2011}}&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called [[overfitting]]. To overcome this, the evaluation uses a [[test set]] of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a [[training set]] of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had ''not'' been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as [[Receiver operating characteristic|ROC curves]].&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called overfitting. To overcome this, the evaluation uses a test set of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a training set of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had not been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as ROC curves.&lt;br /&gt;
&lt;br /&gt;
从数据中发现知识的最后一步是验证数据挖掘算法产生的模式是否存在于更广泛的数据集中。数据挖掘算法发现的并非所有模式都是有效的，因为对于数据挖掘算法来说，在训练集中发现一般数据集中没有的模式是很常见的，这叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''。为了克服这个问题，评估使用一组测试数据，而数据挖掘算法并没有在这些测试数据上进行训练。然后将学习到的模式应用到这个'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;测试集 Test Set&amp;lt;/font&amp;gt;'''中，并将结果输出与期望的输出进行比较。例如，试图区分“垃圾邮件”和“合法”邮件的数据挖掘算法将根据一组电子邮件'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;训练集 Training Sett&amp;lt;/font&amp;gt;'''样本进行训练。训练完毕后，学到的模式将应用于未经训练的那部分电子邮件测试集数据上。然后，可以从这些模式正确分类的电子邮件数量来衡量这些模式的准确性。可以使用几种统计方法可以用来评估算法，如'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;ROC 曲线 ROC curves&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
如果学习的模式不能达到预期的标准，那么就需要重新评估和修改预处理和数据挖掘的步骤。如果所学的模式确实符合所需的标准，那么最后一步就是对习得的模式进行解释并将其转化为知识。&lt;br /&gt;
&lt;br /&gt;
==研究 Research==&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the [[Association for Computing Machinery]]'s (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining ([[SIGKDD]]).&amp;lt;ref&amp;gt;{{cite web|url=http://academic.research.microsoft.com/?SearchDomain=2&amp;amp;SubDomain=7&amp;amp;entitytype=2|title=Microsoft Academic Search: Top conferences in data mining | publisher=[[Microsoft Academic Search]]}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|url=https://scholar.google.de/citations?view_op=top_venues&amp;amp;hl=en&amp;amp;vq=eng_datamininganalysis|title=Google Scholar: Top publications - Data Mining &amp;amp; Analysis|publisher=[[Google Scholar]]}}&amp;lt;/ref&amp;gt; Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings,&amp;lt;ref&amp;gt;[http://www.kdd.org/conferences.php Proceedings] {{Webarchive|url=https://web.archive.org/web/20100430120252/http://www.kdd.org/conferences.php |date=2010-04-30 }}, International Conferences on Knowledge Discovery and Data Mining, ACM, New York.&amp;lt;/ref&amp;gt; and since 1999 it has published a biannual [[academic journal]] titled &amp;quot;SIGKDD Explorations&amp;quot;.&amp;lt;ref&amp;gt;[http://www.kdd.org/explorations/about.php SIGKDD Explorations], ACM, New York.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the Association for Computing Machinery's (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining (SIGKDD). Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings, and since 1999 it has published a biannual academic journal titled &amp;quot;SIGKDD Explorations&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
该领域的首要专业机构是计算机协会 ACM的知识发现和数据挖掘特别兴趣小组 SIGKDD。自1989年以来，ACM SIG每年举办一次国际会议并出版会议记录，自1999年起，它还出版了一份名为“SIGKDD探索”的两年期学术期刊。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
关于数据挖掘的计算机科学会议包括:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[CIKM Conference]] – ACM [[Conference on Information and Knowledge Management]]&lt;br /&gt;
&lt;br /&gt;
CIKM会议 ：ACM'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;信息和知识管理会议 Conference on Information and Knowledge Management&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
* [[European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases]]&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;欧洲机器学习与数据库知识发现原理与实践会议 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
* [[KDD Conference]] – ACM SIGKDD [[Conference on Knowledge Discovery and Data Mining]]&lt;br /&gt;
&lt;br /&gt;
KDD会议：ACM SIGKDD的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;知识发现与数据挖掘会议 Conference on Knowledge Discovery and Data Mining&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many [[List of computer science conferences#Data Management|data management/database conferences]] such as the ICDE Conference, [[SIGMOD|SIGMOD Conference]] and [[International Conference on Very Large Data Bases]]&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many data management/database conferences such as the ICDE Conference, SIGMOD Conference and International Conference on Very Large Data Bases.&lt;br /&gt;
&lt;br /&gt;
数据挖掘专题也出现在许多数据管理/数据库会议上，如 ICDE会议、 '''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;SIGMOD会议 SIGMOD Conference&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关于超大数据库国际会议International Conference on Very Large Data Bases&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
==标准 Standards==&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European [[Cross Industry Standard Process for Data Mining]] (CRISP-DM 1.0) and the 2004 [[Java Data Mining]] standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European Cross Industry Standard Process for Data Mining (CRISP-DM 1.0) and the 2004 Java Data Mining standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
为数据挖掘过程定义了一些标准，例如1999年欧洲跨行业数据挖掘标准流程（CRISP-DM 1.0）和2004年Java数据挖掘标准（JDM 1.0）。这些程序的后续程序（CRISP-DM 2.0和 JDM 2.0）的开发活跃于2006年，但此后一直停滞不前。Jdm 2.0没有达成最终草案就被撤销了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in [[predictive analytics]]&amp;amp;nbsp;– the key standard is the [[Predictive Model Markup Language]] (PMML), which is an [[XML]]-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) [[subspace clustering]] have been proposed independently of the DMG.&amp;lt;ref&amp;gt;{{Cite book | last1 = Günnemann | first1 = Stephan | last2 = Kremer | first2 = Hardy | last3 = Seidl | first3 = Thomas | doi = 10.1145/2023598.2023605 | chapter = An extension of the PMML standard to subspace clustering models | title = Proceedings of the 2011 workshop on Predictive markup language modeling - PMML '11 | pages = 48 | year = 2011 | isbn = 978-1-4503-0837-3 | pmid =  | pmc = }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in predictive analytics&amp;amp;nbsp;– the key standard is the Predictive Model Markup Language (PMML), which is an XML-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) subspace clustering have been proposed independently of the DMG.&lt;br /&gt;
&lt;br /&gt;
为了交换所提取的模型，特别是在预测分析中使用，关键的标准是预测模型标记语言 PMML，这是一种基于 XML 的语言，由数据挖掘集团 DMG 开发，并支持作为交换格式的许多数据挖掘应用程序。顾名思义，它只涵盖预测模型，这是一项对业务应用程序非常重要的特殊数据挖掘任务。然而，覆盖子空间聚类的扩展已经独立于 DMG 被提出。&lt;br /&gt;
&lt;br /&gt;
==显著用途 Notable uses==&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable [[examples of data mining]] can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable examples of data mining can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
数据挖掘在任何有数字数据可用的地方都可以被使用。数据挖掘的著名例子可以在商业、医学、科学和监控领域找到。&lt;br /&gt;
&lt;br /&gt;
==隐私问题和道德规范 Privacy concerns and ethics==&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&amp;lt;ref&amp;gt;{{cite journal |author=Seltzer, William |title=The Promise and Pitfalls of Data Mining: Ethical Issues |url=https://ww2.amstat.org/committees/ethics/linksdir/Jsm2005Seltzer.pdf|publisher = American Statistical Association|journal = ASA Section on Government Statistics|date = 2005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&lt;br /&gt;
&lt;br /&gt;
虽然“数据挖掘”这个术语本身可能没有伦理含义，但它通常与人们行为（伦理和其他）相关的信息挖掘有关。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding [[privacy]], legality, and ethics.&amp;lt;ref&amp;gt;{{cite journal |author=Pitts, Chip |title=The End of Illegal Domestic Spying? Don't Count on It |url=http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |journal=Washington Spectator |date=15 March 2007 |url-status=dead |archiveurl=https://web.archive.org/web/20071128015201/http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |archivedate=2007-11-28 }}&amp;lt;/ref&amp;gt; In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the [[Total Information Awareness]] Program or in [[ADVISE]], has raised privacy concerns.&amp;lt;ref&amp;gt;{{cite journal |author=Taipale, Kim A. |title=Data Mining and Domestic Security: Connecting the Dots to Make Sense of Data |url=http://www.stlr.org/cite.cgi?volume=5&amp;amp;article=2 |journal=Columbia Science and Technology Law Review |volume=5 |issue=2 |date=15 December 2003 |ssrn=546782 |oclc=45263753 }}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|last1=Resig|first1=John|title=A Framework for Mining Instant Messaging Services|url=https://johnresig.com/files/research/SIAMPaper.pdf|accessdate=16 March 2018}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding privacy, legality, and ethics. In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the Total Information Awareness Program or in ADVISE, has raised privacy concerns.&lt;br /&gt;
&lt;br /&gt;
在某些情况下，数据挖掘的使用方式可能会引发隐私、合法性和伦理问题。特别是，为国家安全或执法目的而进行的政府或商业数据集的数据挖掘，如在全面信息意识项目或在 ADVISE 中，引起了隐私问题。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through [[aggregate function|data aggregation]]. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent).&amp;lt;ref name=&amp;quot;NASCIO&amp;quot;&amp;gt;[http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf ''Think Before You Dig: Privacy Implications of Data Mining &amp;amp; Aggregation''] {{webarchive|url=https://web.archive.org/web/20081217063043/http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf |date=2008-12-17 }}, NASCIO Research Brief, September 2004&amp;lt;/ref&amp;gt; This is not data mining ''per se'', but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&amp;lt;ref&amp;gt;{{cite magazine |first=Paul |last=Ohm |title=Don't Build a Database of Ruin |magazine=Harvard Business Review |url=http://blogs.hbr.org/cs/2012/08/dont_build_a_database_of_ruin.html}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/12/03/iron-cagebook/ Iron Cagebook - The Logical End of Facebook's Patents], [[Counterpunch.org]], 2013.12.03&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/09/11/inside-the-tech-industrys-startup-conference/ Inside the Tech industry's Startup Conference], [[Counterpunch.org]], 2013.09.11&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through data aggregation. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent). This is not data mining per se, but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&lt;br /&gt;
&lt;br /&gt;
数据挖掘需要进行数据准备，以发现损害机密性和隐私义务的信息或模式。实现这一点的一种常见方式是通过'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据聚合 Data Aggregation&amp;lt;/font&amp;gt;'''。数据聚合包括以一种便于分析的方式将数据（可能来自不同的来源）组合在一起（但这也可能使私人、个人级别的数据的识别变得可推断或以其他方式显而易见）。但这并不是数据挖掘本身，而是在分析之前以及为分析目的准备数据的结果。当数据被编译后，数据挖掘者或任何有权访问新编译的数据集的人能够识别特定的个人，特别是当数据最初是匿名的时，对个人隐私的威胁就开始发挥作用了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It is recommended{{whom|date=August 2019}} to be aware of the following '''before''' data are collected:&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
It is recommended to be aware of the following before data are collected:&lt;br /&gt;
&lt;br /&gt;
在收集数据之前，建议注意以下事项:&lt;br /&gt;
&lt;br /&gt;
* The purpose of the data collection and any (known) data mining projects;&lt;br /&gt;
&lt;br /&gt;
数据收集和任何（已知的）数据挖掘项目的目的；&lt;br /&gt;
&lt;br /&gt;
* How the data will be used;&lt;br /&gt;
&lt;br /&gt;
数据使用的方法；&lt;br /&gt;
&lt;br /&gt;
* Who will be able to mine the data and use the data and their derivatives;&lt;br /&gt;
&lt;br /&gt;
谁将能够挖掘数据并使用这些数据及其衍生工具；&lt;br /&gt;
&lt;br /&gt;
* The status of security surrounding access to the data;&lt;br /&gt;
&lt;br /&gt;
数据访问的安全状态；&lt;br /&gt;
&lt;br /&gt;
* How collected data can be updated.&lt;br /&gt;
&lt;br /&gt;
如何更新收集的数据。&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to ''become'' anonymous, so that individuals may not readily be identified.&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt; However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&amp;lt;ref&amp;gt;[http://www.securityfocus.com/brief/277 ''AOL search data identified individuals''], SecurityFocus, August 2006&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to become anonymous, so that individuals may not readily be identified.However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&lt;br /&gt;
&lt;br /&gt;
数据也可以被修改成匿名的，这样个人就不容易被修改了确定。但是，甚至“匿名化”的数据集也可能包含足够的信息用来识别个人，就像记者能够根据一组无意中搜索历史找到几个个人一样美国在线发布。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of [[personally identifiable information]] leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of [[privacy violation]], the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&amp;lt;ref&amp;gt;{{Cite journal|title = Big data׳s impact on privacy, security and consumer welfare|journal = Telecommunications Policy|pages = 1134–1145|volume = 38|issue = 11|doi = 10.1016/j.telpol.2014.10.002|first = Nir|last = Kshetri|year = 2014|url = http://libres.uncg.edu/ir/uncg/f/N_Kshetri_Big_2014.pdf}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of personally identifiable information leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of privacy violation, the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
无意中泄露个人身份信息导致提供者违反了公平信息惯例。这种轻率的行为会对指定的个人造成经济、情感或身体伤害。在一起侵犯隐私的案例中，沃尔格林 Walgreens的赞助人在2011年对该公司提起诉讼，指控该公司向数据挖掘公司出售处方信息，而数据挖掘公司又将这些数据提供给制药公司。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲的情况 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[European Union|Europe]] has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the [[International Safe Harbor Privacy Principles|U.S.-E.U. Safe Harbor Principles]], developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of [[Edward Snowden]]'s [[global surveillance disclosure]], there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the [[National Security Agency]], and attempts to reach an agreement with the United States have failed.&amp;lt;ref&amp;gt;{{cite web |url=https://crsreports.congress.gov/product/pdf/R/R44257/7 |title=U.S.-E.U. Data Privacy: From Safe Harbor to Privacy Shield |last1=Weiss |first1=Martin A. |last2=Archick |first2=Kristin |date=19 May 2016 |department= |website= |series= |agency=Congressional Research Service |location=Washington, D.C. |page=6 |pages= |format=PDF |id=R44257 |access-date=9 April 2020 |quote=On October 6, 2015, the [[Court of Justice of the European Union|CJEU]]&amp;amp;nbsp;... issued a decision that invalidated Safe Harbor (effective immediately), as currently implemented. }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Europe has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the U.S.-E.U. Safe Harbor Principles, developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of Edward Snowden's global surveillance disclosure, there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the National Security Agency, and attempts to reach an agreement with the United States have failed.&lt;br /&gt;
&lt;br /&gt;
欧洲有相当强的隐私法，正在努力进一步加强消费者的权利。然而，1998年至2000年期间制定的《美国-欧盟安全港原则》（U.S.-E.U.Safe Harbor Principles）目前有效地使欧洲用户受到美国公司的隐私剥削。由于爱德华·斯诺登 Edward Snowden披露了全球监控信息后，关于撤销这一协议的讨论越来越多，尤其是数据将完全暴露给国家安全局，与美国达成协议的尝试也失败了。&lt;br /&gt;
&lt;br /&gt;
===美国的情况 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the [[US Congress]] via the passage of regulatory controls such as the [[Health Insurance Portability and Accountability Act]] (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in ''Biotech Business Week'', &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot;&amp;lt;ref&amp;gt;Biotech Business Week Editors (June 30, 2008); ''BIOMEDICINE; HIPAA Privacy Rule Impedes Biomedical Research'', Biotech Business Week, retrieved 17 November 2009 from LexisNexis Academic&amp;lt;/ref&amp;gt; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the US Congress via the passage of regulatory controls such as the Health Insurance Portability and Accountability Act (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in Biotech Business Week, &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
在美国，美国国会通过了《健康保险便携性和责任法案》（HIPAA）等监管措施，解决了隐私问题。HIPAA要求个人就其提供的信息及其当前和未来的预期用途给予“知情同意”。根据《生物技术商业周刊》的一篇文章，“在实践中，HIPAA可能不会比研究领域长期存在的法规提供更大的保护。”。更重要的是，该规则通过知情同意进行保护的目标是接近普通个人的不可理解程度。”这突出了数据聚合和挖掘实践中数据匿名的必要性。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the [[Family Educational Rights and Privacy Act]] (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the Family Educational Rights and Privacy Act (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
美国信息隐私立法，如 HIPAA 和《家庭教育权利和隐私法》（FERPA）仅适用于每一个此类法律所涉及的特定领域。美国大多数企业对数据挖掘的使用并不受任何法律的控制。&lt;br /&gt;
&lt;br /&gt;
== 数据挖掘与著作权法 Copyright law==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Under [[Copyright law of the European Union|European copyright]] and [[Database Directive|database law]]s, the mining of in-copyright works (such as by [[web mining]]) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright{{snd}} but database rights may exist so data mining becomes subject to [[intellectual property]] owners' rights that are protected by the [[Database Directive]]. On the recommendation of the [[Hargreaves review]], this led to the UK government to amend its copyright law in 2014 to allow content mining as a [[Limitations and exceptions to copyright|limitation and exception]].&amp;lt;ref&amp;gt;[http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ UK Researchers Given Data Mining Right Under New UK Copyright Laws.] {{webarchive |url=https://web.archive.org/web/20140609020315/http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ |date=June 9, 2014 }} ''Out-Law.com.''   Retrieved 14 November 2014&amp;lt;/ref&amp;gt; The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the [[Information Society Directive]] (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
Under European copyright and database laws, the mining of in-copyright works (such as by web mining) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright but database rights may exist so data mining becomes subject to intellectual property owners' rights that are protected by the Database Directive. On the recommendation of the Hargreaves review, this led to the UK government to amend its copyright law in 2014 to allow content mining as a limitation and exception. The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the Information Society Directive (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
根据欧洲版权法和数据库法，未经版权所有人许可而对版权作品进行挖掘（如通过网络挖掘）是不合法的。在欧洲，如果数据库是纯数据，可能没有版权，但数据库权利可能存在，因此数据挖掘受数据库指令保护的知识产权所有者的权利约束。根据《哈格里夫斯评论》（Hargreaves review）的建议，这导致英国政府在2014年修订了版权法，允许将内容挖掘作为一种限制和例外。英国是继日本之后世界上第二个这样做的国家，日本在2009年引入了数据挖掘的例外。然而，由于信息社会指令（2001年）的限制，英国是例外情况但是只允许非商业目的的内容挖掘。英国版权法也不允许合同条款和条件推翻这一规定。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The [[European Commission]] facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe.&amp;lt;ref&amp;gt;{{cite web|title=Licences for Europe - Structured Stakeholder Dialogue 2013|url=http://ec.europa.eu/licences-for-europe-dialogue/en/content/about-site|website=European Commission|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt; The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and [[open access]] publishers to leave the stakeholder dialogue in May 2013.&amp;lt;ref&amp;gt;{{cite web|title=Text and Data Mining:Its importance and the need for change in Europe|url=http://libereurope.eu/news/text-and-data-mining-its-importance-and-the-need-for-change-in-europe/|website=Association of European Research Libraries|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The European Commission facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe. The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and open access publishers to leave the stakeholder dialogue in May 2013.&lt;br /&gt;
&lt;br /&gt;
2013年，欧盟委员会以“欧洲许可证”为题，推动了利益相关者对文本和数据挖掘的讨论。但他们将重点放在解决这一法律问题上，如许可证而不是限制和例外，导致大学、研究人员、图书馆、民间社会团体和开放获取出版商的代表于2013年5月离开了利益相关者对话。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===美国 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Copyright law of the United States|US copyright law]], and in particular its provision for [[fair use]], upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the [[Google Book Search Settlement Agreement|Google Book settlement]] the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&amp;lt;ref&amp;gt;{{cite web|title=Judge grants summary judgment in favor of Google Books — a fair use victory|url=http://www.lexology.com/library/detail.aspx?g=a18c5b92-5a20-4d1d-a098-a3095046a88e|website=Lexology.com|publisher=Antonelli Law Ltd|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
US copyright law, and in particular its provision for fair use, upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the Google Book settlement the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&lt;br /&gt;
&lt;br /&gt;
美国版权法，特别是其中关于合理使用的条款，支持在美国和其他合理使用国家，如以色列，台湾和韩国采矿内容的合法性。由于内容挖掘是变革性的，也就是说，它不会取代原来的工作，它被视为合法的合理使用。例如，作为谷歌图书和解协议的一部分，此案的主审法官裁定，谷歌版权图书数字化项目是合法的，部分原因在于数字化项目所展示的变革性用途——其中之一就是文本和数据挖掘。&lt;br /&gt;
&lt;br /&gt;
==软件 Software==&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Data mining and machine learning software}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===开源的数据挖掘软件 Free open-source data mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以使用免费 / 开源许可证。应用程序源代码也是对公众开放访问的。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Carrot2]]: Text and search results clustering framework.  文本和搜索结果聚类框架。&lt;br /&gt;
&lt;br /&gt;
* [[Chemicalize.org]]: A chemical structure miner and web search engine.  化学结构挖掘与网络搜索引擎。&lt;br /&gt;
&lt;br /&gt;
* [[ELKI]]: A university research project with advanced [[cluster analysis]] and [[anomaly detection|outlier detection]] methods written in the [[Java (programming language)|Java]] language.  一个大学研究项目，用Java语言编写高级聚类分析和离群点检测方法。&lt;br /&gt;
&lt;br /&gt;
* [[General Architecture for Text Engineering|GATE]]: a [[natural language processing]] and language engineering tool.  一个自然语言处理和语言工程工具。&lt;br /&gt;
&lt;br /&gt;
* [[KNIME]]: The Konstanz Information Miner, a user-friendly and comprehensive data analytics framework.  Konstanz Information Miner，一个用户友好的综合数据分析框架。&lt;br /&gt;
&lt;br /&gt;
* [[MOA (Massive Online Analysis)|Massive Online Analysis (MOA)]]: a real-time big data stream mining with concept drift tool in the [[Java (programming language)|Java]] programming language.  利用Java语言中的概念漂移工具进行实时大数据流挖掘。&lt;br /&gt;
&lt;br /&gt;
* [[Multi expression programming|MEPX]] - cross-platform tool for regression and classification problems based on a Genetic Programming variant.  基于遗传编程变量的回归和分类问题的跨平台工具。&lt;br /&gt;
&lt;br /&gt;
* ML-Flex: A software package that enables users to integrate with third-party machine-learning packages written in any programming language, execute classification analyses in parallel across multiple computing nodes, and produce HTML reports of classification results.  一种软件包，使用户能够与用任何编程语言编写的第三方机器学习包集成，跨多个计算节点并行执行分类分析，并生成分类结果的HTML报告。&lt;br /&gt;
&lt;br /&gt;
* [[mlpack]]: a collection of ready-to-use machine learning algorithms written in the [[C++]] language. 一个用C++语言编写的机器学习算法的集合。&lt;br /&gt;
&lt;br /&gt;
* [[NLTK]] ([[Natural Language Toolkit]]): A suite of libraries and programs for symbolic and statistical natural language processing (NLP) for the [[Python (programming language)|Python]] language.  一套用于Python语言的符号和统计自然语言处理（NLP）的库和程序。&lt;br /&gt;
&lt;br /&gt;
* [[OpenNN]]: Open [[neural networks]] library.  开源的神经网络库。&lt;br /&gt;
&lt;br /&gt;
* [[Orange (software)|Orange]]: A component-based data mining and [[machine learning]] software suite written in the [[Python (programming language)|Python]] language. 一个用Python语言编写的基于组件的数据挖掘和机器学习软件套件。&lt;br /&gt;
&lt;br /&gt;
* [[R (programming language)|R]]: A [[programming language]] and software environment for [[statistics|statistical]] computing, data mining, and graphics. It is part of the [[GNU Project]]. 一种用于统计计算、数据挖掘和图形的编程语言和软件环境。它是GNU项目的一部分。&lt;br /&gt;
&lt;br /&gt;
* [[scikit-learn]] is an open-source machine learning library for the Python programming language  是Python编程语言的一个开源机器学习库&lt;br /&gt;
&lt;br /&gt;
* [[Torch (machine learning)|Torch]]: An [[open source model|open-source]] [[deep learning]] library for the [[Lua (programming language)|Lua]] programming language and [[scientific computing]] framework with wide support for [[machine learning]] algorithms.  一个开源的深度学习lib库语言和科学计算框架，广泛支持机器学习算法。&lt;br /&gt;
&lt;br /&gt;
* [[UIMA]]: The UIMA (Unstructured Information Management Architecture) is a component framework for analyzing unstructured content such as text, audio and video – originally developed by IBM.  UIMA（非结构化信息管理体系结构）是一个用于分析非结构化内容（如文本、音频和视频）的组件框架，最初由IBM开发。&lt;br /&gt;
&lt;br /&gt;
* [[Weka (machine learning)|Weka]]: A suite of machine learning software applications written in the [[Java (programming language)|Java]] programming language.  用Java编程语言编写的一套机器学习软件应用程序。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===需要专有许可的数据挖掘软件和应用程序 Proprietary data-mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以根据专有许可证提供。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Angoss]] KnowledgeSTUDIO: data mining tool  数据挖掘工具。&lt;br /&gt;
&lt;br /&gt;
* [[LIONsolver]]: an integrated software application for data mining, business intelligence, and modeling that implements the Learning and Intelligent OptimizatioN (LION) approach.  用于数据挖掘、商业智能和建模的集成软件应用程序，实现学习和智能优化（LION）方法。&lt;br /&gt;
&lt;br /&gt;
* Megaputer Intelligence: data and text mining software is called PolyAnalyst.  数据和文本挖掘软件PolyAnalyst。&lt;br /&gt;
&lt;br /&gt;
* [[Microsoft Analysis Services]]: data mining software provided by [[Microsoft]].  微软提供的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[NetOwl]]: suite of multilingual text and entity analytics products that enable data mining.  支持数据挖掘的多语言文本和实体分析产品套件。&lt;br /&gt;
&lt;br /&gt;
* [[Oracle Data Mining]]: data mining software by [[Oracle Corporation]].  Oracle公司的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[PSeven]]: platform for automation of engineering simulation and analysis, multidisciplinary optimization and data mining provided by [[DATADVANCE]].  DATADVANCE为工程仿真分析、多学科优化和数据挖掘提供自动化平台。&lt;br /&gt;
&lt;br /&gt;
* [[Qlucore]] Omics Explorer: data mining software.  数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[RapidMiner]]: An environment for [[machine learning]] and data mining experiments. &amp;lt;!-- Latest version is NOT opensource --&amp;gt;  一个用于机器学习和数据挖掘实验的环境。&lt;br /&gt;
&lt;br /&gt;
* [[SAS (software)#Components|SAS Enterprise Miner]]: data mining software provided by the [[SAS Institute]].  SAS机构提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[SPSS Modeler]]: data mining software provided by [[IBM]].  IBM提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[STATISTICA]] Data Miner: data mining software provided by [[StatSoft]].  StatSoft提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[Tanagra (machine learning)|Tanagra]]: Visualisation-oriented data mining software, also for teaching.  面向可视化的数据挖掘软件，也用于教学。&lt;br /&gt;
&lt;br /&gt;
* [[Vertica]]: data mining software provided by [[Hewlett-Packard]].  惠普提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
==扩展链接 See also==&lt;br /&gt;
&lt;br /&gt;
; Methods&lt;br /&gt;
&lt;br /&gt;
方法&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Agent mining]]  主体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection|Anomaly/outlier/change detection]]  异常/异常/变化检测&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]]  关联规则学习&lt;br /&gt;
&lt;br /&gt;
* [[Bayesian network]]s  贝叶斯网络&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]]  分类&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis]]  聚类分析&lt;br /&gt;
&lt;br /&gt;
* [[Decision tree]]s  决策树&lt;br /&gt;
&lt;br /&gt;
* [[Ensemble learning]]  集成学习&lt;br /&gt;
&lt;br /&gt;
* [[Factor analysis]]  因子分析&lt;br /&gt;
&lt;br /&gt;
* [[Genetic algorithms]]  遗传算法&lt;br /&gt;
&lt;br /&gt;
* [[Intention mining]]  意向玩具&lt;br /&gt;
&lt;br /&gt;
* [[Learning classifier system]]  学习分类器系统&lt;br /&gt;
&lt;br /&gt;
* [[Multilinear subspace learning]]  多线性子空间学习&lt;br /&gt;
&lt;br /&gt;
* [[Artificial neural network|Neural network]]s  神经网络&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis]]  回归分析&lt;br /&gt;
&lt;br /&gt;
* [[Sequence mining]]   序列挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Structured data analysis (statistics)|Structured data analysis]]  结构数据学习&lt;br /&gt;
&lt;br /&gt;
* [[Support vector machines]]  支持向量机&lt;br /&gt;
&lt;br /&gt;
* [[Text mining]]  文本挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Time series|Time series analysis]]  时间序列分析&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application domains&lt;br /&gt;
&lt;br /&gt;
应用领域&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Analytics]] 分析&lt;br /&gt;
&lt;br /&gt;
* [[Behavior informatics]]  行为信息学&lt;br /&gt;
&lt;br /&gt;
* [[Big Data|Big data]]  大数据&lt;br /&gt;
&lt;br /&gt;
* [[Bioinformatics]]  生物信息学&lt;br /&gt;
&lt;br /&gt;
* [[Business intelligence]]  商务智能&lt;br /&gt;
&lt;br /&gt;
* [[Data analysis]]  数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Data warehouse]]  数据仓库&lt;br /&gt;
&lt;br /&gt;
* [[Decision support system]]  决策支持系统&lt;br /&gt;
&lt;br /&gt;
* [[Domain driven data mining]]  域驱动的数据挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Drug discovery]]  药物发现&lt;br /&gt;
&lt;br /&gt;
* [[Exploratory data analysis]]  探索性数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Predictive analytics]]  预测分析&lt;br /&gt;
&lt;br /&gt;
* [[Web mining]]  网页挖掘&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application examples&lt;br /&gt;
&lt;br /&gt;
应用示例&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|=&lt;br /&gt;
&lt;br /&gt;
*[[Automatic number plate recognition in the United Kingdom#Data mining|Automatic number plate recognition in the United Kingdom]]  英国的自动车牌识别&lt;br /&gt;
&lt;br /&gt;
*[[Customer analytics#Data mining|Customer analytics]]  客户分析&lt;br /&gt;
&lt;br /&gt;
*[[Educational data mining]]  教育数据挖掘&lt;br /&gt;
&lt;br /&gt;
*[[National Security Agency#Transaction data mining|National Security Agency]]  国家安全局&lt;br /&gt;
&lt;br /&gt;
*[[Quantitative structure–activity relationship#Data mining approach|Quantitative structure–activity relationship]]  数量结构-活动关系&lt;br /&gt;
&lt;br /&gt;
*[[Surveillance#Data mining and profiling|Surveillance]] / [[Mass surveillance#Data mining|Mass surveillance]] (e.g., [[Stellar Wind (code name)|Stellar Wind]])&lt;br /&gt;
监控/大规模监测（例如，恒星风）&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Related topics&lt;br /&gt;
&lt;br /&gt;
相关话题&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to ''analyzing'' data) , see:&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to analyzing data) , see:&lt;br /&gt;
&lt;br /&gt;
有关从数据中提取信息(与分析数据相反)的详细信息，请参阅:&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Data integration]]  数据集成&lt;br /&gt;
&lt;br /&gt;
* [[Data transformation]]  数据转换&lt;br /&gt;
&lt;br /&gt;
* [[Electronic discovery]]  电子发现&lt;br /&gt;
&lt;br /&gt;
* [[Information extraction]]  信息提取&lt;br /&gt;
&lt;br /&gt;
* [[Information integration]]  信息集成&lt;br /&gt;
&lt;br /&gt;
* [[Named-entity recognition]]  命名实体识别&lt;br /&gt;
&lt;br /&gt;
* [[Profiling (information science)]]  分析（信息科学）&lt;br /&gt;
&lt;br /&gt;
* [[Psychometrics]]  心理测量学&lt;br /&gt;
&lt;br /&gt;
* [[Social media mining]]  社交媒体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Surveillance capitalism]]  资本监视&lt;br /&gt;
&lt;br /&gt;
* [[Web scraping]]  网页抓取&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
;Other resources&lt;br /&gt;
&lt;br /&gt;
Other resources&lt;br /&gt;
&lt;br /&gt;
其他资源&lt;br /&gt;
&lt;br /&gt;
*[[International Journal of Data Warehousing and Mining]]  国际数据仓库与挖掘杂志&lt;br /&gt;
&lt;br /&gt;
==参考文献 References==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|30em}}&lt;br /&gt;
&lt;br /&gt;
==进一步阅读 Further reading==&lt;br /&gt;
&lt;br /&gt;
{{div col|colwidth=30em}}&lt;br /&gt;
&lt;br /&gt;
* Cabena, Peter; Hadjnian, Pablo; Stadler, Rolf; Verhees, Jaap; Zanasi, Alessandro (1997); ''Discovering Data Mining: From Concept to Implementation'', [[Prentice Hall]], {{ISBN|0-13-743980-6}}&lt;br /&gt;
&lt;br /&gt;
* M.S. Chen, J. Han, [[Philip S. Yu|P.S. Yu]] (1996) &amp;quot;[http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/chen_tkde96.pdf Data mining: an overview from a database perspective]&amp;quot;. ''Knowledge and data Engineering, IEEE Transactions'' on 8 (6), 866–883&lt;br /&gt;
&lt;br /&gt;
* Feldman, Ronen; Sanger, James (2007); ''The Text Mining Handbook'', [[Cambridge University Press]], {{ISBN|978-0-521-83657-9}}&lt;br /&gt;
&lt;br /&gt;
* Guo, Yike; and Grossman, Robert (editors) (1999); ''High Performance Data Mining: Scaling Algorithms, Applications and Systems'', [[Kluwer Academic Publishers]]&lt;br /&gt;
&lt;br /&gt;
* [[Jiawei Han|Han, Jiawei]], Micheline Kamber, and Jian Pei. ''Data mining: concepts and techniques''. Morgan kaufmann, 2006.&lt;br /&gt;
&lt;br /&gt;
* [[Trevor Hastie|Hastie, Trevor]], [[Robert Tibshirani|Tibshirani, Robert]] and [[Jerome H. Friedman|Friedman, Jerome]] (2001); ''The Elements of Statistical Learning: Data Mining, Inference, and Prediction'', Springer, {{ISBN|0-387-95284-5}}&lt;br /&gt;
&lt;br /&gt;
* [[Bing Liu (computer scientist)|Liu, Bing]] (2007, 2011); ''Web Data Mining: Exploring Hyperlinks, Contents and Usage Data'', [[Springer Verlag|Springer]], {{ISBN|3-540-37881-2}}&lt;br /&gt;
&lt;br /&gt;
* {{cite journal |last=Murphy |first=Chris |date=16 May 2011 |title=Is Data Mining Free Speech? |journal=[[InformationWeek]] |page=12 }}&lt;br /&gt;
&lt;br /&gt;
* Nisbet, Robert; Elder, John; Miner, Gary (2009); ''Handbook of Statistical Analysis &amp;amp; Data Mining Applications'', [[Academic Press]]/Elsevier, {{ISBN|978-0-12-374765-5}}&lt;br /&gt;
&lt;br /&gt;
* Poncelet, Pascal; Masseglia, Florent; and Teisseire, Maguelonne (editors) (October 2007); &amp;quot;Data Mining Patterns: New Methods and Applications&amp;quot;, ''Information Science Reference'', {{ISBN|978-1-59904-162-9}}&lt;br /&gt;
&lt;br /&gt;
* Tan, Pang-Ning; Steinbach, Michael; and Kumar, Vipin (2005); ''Introduction to Data Mining'', {{ISBN|0-321-32136-7}}&lt;br /&gt;
&lt;br /&gt;
* Theodoridis, Sergios; and Koutroumbas, Konstantinos (2009); ''Pattern Recognition'', 4th Edition, Academic Press, {{ISBN|978-1-59749-272-0}}&lt;br /&gt;
&lt;br /&gt;
* Weiss, Sholom M.; and Indurkhya, Nitin (1998); ''Predictive Data Mining'', [[Morgan Kaufmann]]&lt;br /&gt;
&lt;br /&gt;
* {{cite book |author1=Witten, Ian H.|authorlink1=Ian H. Witten |author2=Frank, Eibe |author3=Hall, Mark A. |title=Data Mining: Practical Machine Learning Tools and Techniques |edition=3 |date=30 January 2011 |publisher=Elsevier |isbn=978-0-12-374856-0 }} (See also [[Weka (machine learning)|Free Weka software]])&lt;br /&gt;
&lt;br /&gt;
* Ye, Nong (2003); ''The Handbook of Data Mining'', Mahwah, NJ: Lawrence Erlbaum&lt;br /&gt;
&lt;br /&gt;
{{div col end}}&lt;br /&gt;
&lt;br /&gt;
==相关链接External links==&lt;br /&gt;
&lt;br /&gt;
{{Commons category|Data mining}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Reference/Knowledge_Management/Knowledge_Discovery/Software|Knowledge Discovery Software}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Computers/Software/Databases/Data_Mining/Tool_Vendors|Data Mining Tool Vendors}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{data}}&lt;br /&gt;
&lt;br /&gt;
{{Data warehouse}}&lt;br /&gt;
&lt;br /&gt;
{{Computer science}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{Authority control}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{DEFAULTSORT:Data Mining}}&lt;br /&gt;
&lt;br /&gt;
[[Category:Data mining| ]]&lt;br /&gt;
&lt;br /&gt;
[[Category:Formal sciences]]&lt;br /&gt;
&lt;br /&gt;
Category:Formal sciences&lt;br /&gt;
&lt;br /&gt;
类别: 正规科学&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Data mining]]. Its edit history can be viewed at [[数据挖掘/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13897</id>
		<title>数据挖掘</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13897"/>
		<updated>2020-09-11T04:54:53Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条由许菁翻译整理。&lt;br /&gt;
&lt;br /&gt;
{{Machine learning bar}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Data mining''' is the process of discovering patterns in large [[data set]]s involving methods at the intersection of [[machine learning]], [[statistics]], and [[database system]]s.&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; Data mining is an [[interdisciplinary]] subfield of [[computer science]] and [[statistics]] with an overall goal to extract information (with intelligent methods) from a data set and transform the information into a comprehensible structure for further use.&amp;lt;ref name=&amp;quot;acm&amp;quot;&amp;gt;{{cite web |url=http://www.kdd.org/curriculum/index.html |title=Data Mining Curriculum |publisher=[[Association for Computing Machinery|ACM]] [[SIGKDD]] |date=2006-04-30 |accessdate=2014-01-27 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;brittanica&amp;quot;&amp;gt;{{cite web |last=Clifton |first=Christopher |title=Encyclopædia Britannica: Definition of Data Mining |year=2010 |url=http://www.britannica.com/EBchecked/topic/1056150/data-mining |accessdate=2010-12-09 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;elements&amp;quot;&amp;gt;{{cite web|last1=Hastie|first1=Trevor|authorlink1=Trevor Hastie|last2=Tibshirani|first2=Robert|authorlink2=Robert Tibshirani|last3=Friedman|first3=Jerome|authorlink3=Jerome H. Friedman|title=The Elements of Statistical Learning: Data Mining, Inference, and Prediction|year=2009|url=http://www-stat.stanford.edu/~tibs/ElemStatLearn/|accessdate=2012-08-07|archive-url=https://web.archive.org/web/20091110212529/http://www-stat.stanford.edu/~tibs/ElemStatLearn/|archive-date=2009-11-10|url-status=dead}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book|last1=Han, Kamber, Pei|first1=Jaiwei, Micheline, Jian|title=Data Mining: Concepts and Techniques|date=June 9, 2011|publisher=Morgan Kaufmann|isbn=978-0-12-381479-1|edition=3rd}}&amp;lt;/ref&amp;gt; Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt; Aside from the raw analysis step, it also involves database and [[data management]] aspects, [[data pre-processing]], [[statistical model|model]] and [[Statistical inference|inference]] considerations, interestingness metrics, [[Computational complexity theory|complexity]] considerations, post-processing of discovered structures, [[Data visualization|visualization]], and [[Online algorithm|online updating]].&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; &lt;br /&gt;
&lt;br /&gt;
Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD. Aside from the raw analysis step, it also involves database and data management aspects, data pre-processing, model and inference considerations, interestingness metrics, complexity considerations, post-processing of discovered structures, visualization, and online updating. &lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘 Data Mining &amp;lt;/font&amp;gt;'''是在大型数据集中发现模式的过程，是一种涉及到机器学习、统计学和数据库系统综合使用的方法。数据挖掘是指“在数据库中发现知识(knowledge discovery in databases,KDD)”过程中的分析步骤。除了传统的分析步骤，它还涉及数据库和数据管理方面，包括数据预处理、模型和推理考虑、兴趣度量、复杂性考虑、发现结构的后处理、可视化和在线更新等内容。&lt;br /&gt;
&lt;br /&gt;
--[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“数据挖掘是指“在数据库中知识发现KDD”的过程的分析步骤”一句中的“在数据库中知识发现KDD”处改为“在数据库中发现知识(knowledge discovery in databases,KDD)”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a [[misnomer]], because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (''mining'') of data itself.&amp;lt;ref name=&amp;quot;han-kamber&amp;quot;&amp;gt;{{cite book|title=Data mining: concepts and techniques|last1=Han|first1=Jiawei|last2=Kamber|first2=Micheline|date=2001|publisher=[[Morgan Kaufmann]]|isbn=978-1-55860-489-6|page=5|quote=Thus, data mining should have been more appropriately named &amp;quot;knowledge mining from data,&amp;quot; which is unfortunately somewhat long|authorlink1=Jiawei Han}}&amp;lt;/ref&amp;gt; It also is a [[buzzword]]&amp;lt;ref&amp;gt;[http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf OKAIRP 2005 Fall Conference, Arizona State University] {{Webarchive|url=https://web.archive.org/web/20140201170452/http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf|date=2014-02-01}}&amp;lt;/ref&amp;gt; and is frequently applied to any form of large-scale data or [[information processing]] ([[Data collection|collection]], [[information extraction|extraction]], [[Data warehouse|warehousing]], analysis, and statistics) as well as any application of [[Decision support system|computer decision support system]], including [[artificial intelligence]] (e.g., machine learning) and [[business intelligence]]. The book ''Data mining: Practical machine learning tools and techniques with Java''&amp;lt;ref name=&amp;quot;witten&amp;quot;&amp;gt;{{cite book|title=Data Mining: Practical Machine Learning Tools and Techniques|last1=Witten|first1=Ian H.|last2=Frank|first2=Eibe|last3=Hall|first3=Mark A.|date=30 January 2011|publisher=Elsevier|isbn=978-0-12-374856-0|edition=3|authorlink1=Ian H. Witten}}&amp;lt;/ref&amp;gt; (which covers mostly machine learning material) was originally to be named just ''Practical machine learning'', and the term ''data mining'' was only added for marketing reasons.&amp;lt;ref&amp;gt;{{Cite journal|author1=Bouckaert, Remco R.|author2=Frank, Eibe|author3=Hall, Mark A.|author4=Holmes, Geoffrey|author5=Pfahringer, Bernhard|author6=Reutemann, Peter|author7=Witten, Ian H.|authorlink7=Ian H. Witten|year=2010|title=WEKA Experiences with a Java open-source project|journal=Journal of Machine Learning Research|volume=11|pages=2533–2541|quote=the original title, &amp;quot;Practical machine learning&amp;quot;, was changed&amp;amp;nbsp;... The term &amp;quot;data mining&amp;quot; was [added] primarily for marketing reasons.|postscript={{inconsistent citations}}}}&amp;lt;/ref&amp;gt; Often the more general terms (''large scale'') ''[[data analysis]]'' and ''[[analytics]]'' – or, when referring to actual methods, ''artificial intelligence'' and ''machine learning'' – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a misnomer, because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (mining) of data itself. It also is a buzzword and is frequently applied to any form of large-scale data or information processing (collection, extraction, warehousing, analysis, and statistics) as well as any application of computer decision support system, including artificial intelligence (e.g., machine learning) and business intelligence. The book Data mining: Practical machine learning tools and techniques with Java (which covers mostly machine learning material) was originally to be named just Practical machine learning, and the term data mining was only added for marketing reasons. Often the more general terms (large scale) data analysis and analytics – or, when referring to actual methods, artificial intelligence and machine learning – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
“数据挖掘”这种形容其实并不十分恰当，因为我们的目标是从大量数据中提取模式和知识，而不是数据本身的提取(挖掘)。它是一个流行语，经常用于任何形式的大规模数据或信息处理（收集、提取、仓储、分析和统计）的场景下，以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 计算机决策系统 Decision Support System，DSS&amp;lt;/font&amp;gt;'''的任何应用当中，包括人工智能（例如机器学习）和商业智能。《数据挖掘：使用Java的实用机器学习工具和技术》（主要涵盖机器学习材料）一书最初被命名为“实用机器学习”，而数据挖掘一词只是为了营销的原因而增加。经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records ([[cluster analysis]]), unusual records ([[anomaly detection]]), and dependencies ([[association rule mining]], [[sequential pattern mining]]). This usually involves using database techniques such as [[spatial index|spatial indices]]. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and [[predictive analytics]]. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a [[decision support system]]. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records (cluster analysis), unusual records (anomaly detection), and dependencies (association rule mining, sequential pattern mining). This usually involves using database techniques such as spatial indices. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and predictive analytics. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a decision support system. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
实际上数据挖掘任务是对大量数据进行半自动或全自动分析，以提取出从前未知的且有趣的模式，如数据记录组(数据聚类)、异常记录组(异常检测)和依赖关系(关联规则挖掘，序列挖掘)。这通常涉及使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种汇总，并且可以用于进一步的分析，或者，例如，机器学习和预测分析。例如，数据挖掘步骤可以识别数据中的多个组，然后可以使用该步骤通过决策支持系统获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是作为附加步骤属于整个 KDD 过程。&lt;br /&gt;
&lt;br /&gt;
如数据记录组（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''）、异常记录（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly Detection&amp;lt;/font&amp;gt;'''）和依赖关系（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则挖掘 Association Rule Mining&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;序列模式挖掘 Sequential Pattern Mining&amp;lt;/font&amp;gt;'''）。这通常涉及到使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种规律总结，可以用于进一步的分析，或者，例如，在机器学习和预测分析中。例如，通过数据挖掘可以出识别数据中的多个组，然后这些组可以通过使用决策支持系统来获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是属于整个KDD过程的附加步骤。&lt;br /&gt;
&lt;br /&gt;
The difference between [[data analysis]] and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&amp;lt;ref&amp;gt;Olson, D. L. (2007). Data mining in business services. ''Service Business'', ''1''(3), 181-193. {{doi|10.1007/s11628-006-0014-7}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The difference between data analysis and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据分析 Data Analysis&amp;lt;/font&amp;gt;'''和数据挖掘的区别在于，数据分析用于测试数据集上的模型和假设，例如，分析营销活动的有效性，而不考虑数据量的多少；相反，数据挖掘使用机器学习和统计模型来发现“大量”数据中的秘密或隐藏模式。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The related terms ''[[data dredging]]'', ''data fishing'', and ''data snooping'' refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
The related terms data dredging, data fishing, and data snooping refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
相关术语'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;“数据疏浚” Data Dredging&amp;lt;/font&amp;gt;'''、“数据钓鱼”和“数据窥探”是指使用数据挖掘方法对较大的人口数据集中的一部分进行抽样，这些数据集太小（或可能太小），无法对所发现的任何模式的有效性作出可靠的统计推断。但是，这些方法可以用于提出新的假设，以针对更大的数据群体进行测试。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==起源 Etymology==&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like ''data fishing'' or ''data dredging'' to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist [[Michael Lovell]] in an article published in the ''[[Review of Economic Studies]]'' in 1983.&amp;lt;ref&amp;gt;{{Cite journal|last=Lovell|first=Michael C.|date=1983|title=Data Mining|journal=The Review of Economics and Statistics|volume=65|issue=1|pages=1–12|doi=10.2307/1924403|jstor=1924403}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book |first=Wojciech W. |last=Charemza |first2=Derek F. |last2=Deadman |title=New Directions in Econometric Practice |location=Aldershot |publisher=Edward Elgar |year=1992 |chapter=Data Mining |pages=14–31 |isbn=1-85278-461-X }}&amp;lt;/ref&amp;gt; Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like data fishing or data dredging to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist Michael Lovell in an article published in the Review of Economic Studies in 1983. Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
在20世纪60年代，统计学家和经济学家们曾经使用“数据钓鱼”或”数据疏浚“等术语来指代他们认为在没有先验假设的情况下进行数据分析的糟糕做法。经济学家迈克尔•洛弗尔 Michael Lovell 在1983年《经济研究评论》（Review of Economic Studies）上发表的一篇文章中，也以类似的批判方式使用了“数据挖掘”这个术语。Lovell 指出，这种做法“伪装成各种别名，从“实验”(正面)到“钓鱼”或“窥探”(负面)。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term ''data mining'' appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation;&amp;lt;ref name=&amp;quot;Mena&amp;quot;&amp;gt;{{cite book |last=Mena |first=Jesús |year=2011 |title=Machine Learning Forensics for Law Enforcement, Security, and Intelligence |location=Boca Raton, FL |publisher=CRC Press (Taylor &amp;amp; Francis Group) |isbn=978-1-4398-6069-4 }}&amp;lt;/ref&amp;gt; researchers consequently turned to ''data mining''. Other terms used include ''data archaeology'', ''information harvesting'', ''information discovery'', ''knowledge extraction'', etc. [[Gregory I. Piatetsky-Shapiro|Gregory Piatetsky-Shapiro]] coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic [http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] and this term became more popular in [[Artificial intelligence|AI]] and [[machine learning]] community. However, the term data mining became more popular in the business and press communities.&amp;lt;ref&amp;gt;{{cite web |last1=Piatetsky-Shapiro |first1=Gregory |authorlink1=Gregory Piatetsky-Shapiro |last2=Parker |first2=Gary |url=http://www.kdnuggets.com/data_mining_course/x1-intro-to-data-mining-notes.html |title=Lesson: Data Mining, and Knowledge Discovery: An Introduction |publisher=KD Nuggets |year=2011 |work=Introduction to Data Mining |accessdate=30 August 2012 }}&amp;lt;/ref&amp;gt; Currently, the terms ''data mining'' and ''knowledge discovery'' are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
The term data mining appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation; researchers consequently turned to data mining. Other terms used include data archaeology, information harvesting, information discovery, knowledge extraction, etc. Gregory Piatetsky-Shapiro coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic (KDD-1989) and this term became more popular in AI and machine learning community. However, the term data mining became more popular in the business and press communities. Currently, the terms data mining and knowledge discovery are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
数据挖掘这个术语在1990年左右出现在数据库领域，通常有着积极的内涵。在20世纪80年代的一段短暂时间里，人们曾使用过“数据库挖掘”这种表达，但由于这个词被总部位于圣地亚哥的 HNC 公司注册为商标，因此研究人员转向了数据挖掘。曾用过的其他术语包括数据考古学、信息收集、信息发现、知识提取等。格雷戈里·皮亚特斯基·夏皮罗 Gregory Piatetsky-Shapiro 在关于这个主题的第一个研讨会[ http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] 上首次创造了“数据库中的知识发现 Knowledge Discovery in Databases，KDD”这个术语。此后，这个术语在人工智能和机器学习社区中变得更加流行。然而，数据挖掘这个术语在商业和出版界变得越来越流行。目前，数据挖掘和知识发现 knowledge discovery这两个术语可以互换使用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery ([[KDD-95]]) was started in Montreal under [[AAAI]] sponsorship. It was co-chaired by [[Usama Fayyad]] and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called [[Data Mining and Knowledge Discovery]] as its founding editor-in-chief. Later he started the [[SIGKDD]] Newsletter SIGKDD Explorations.&amp;lt;ref name=SIGKDD-explorations&amp;gt;{{cite journal|last1=Fayyad|first1=Usama|title=First Editorial by Editor-in-Chief|journal=SIGKDD Explorations|date=15 June 1999|volume=13|issue=1|pages=102|doi=10.1145/2207243.2207269|url=http://www.kdd.org/explorations/view/june-1999-volume-1-issue-1|accessdate=27 December 2010|ref=SIGKDD-explorations}}&amp;lt;/ref&amp;gt; The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal ''Data Mining and Knowledge Discovery'' is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery (KDD-95) was started in Montreal under AAAI sponsorship. It was co-chaired by Usama Fayyad and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called Data Mining and Knowledge Discovery as its founding editor-in-chief. Later he started the SIGKDD Newsletter SIGKDD Explorations.The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal Data Mining and Knowledge Discovery is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
在学术界，主要的研究论坛始于1995年，当时，在AAAI的赞助下，第一届数据挖掘和知识发现国际会议（KDD-95）在蒙特利尔召开。会议由乌萨马·法耶兹 Usama Fayyad和拉玛萨米·乌图鲁萨米 Ramasamy Uthurusamy共同主持。一年后，1996年Usama Fayyad创办了杂志《数据挖掘与知识发现》（datamining and Knowledge Discovery），担任创始主编。后来他创办了SIGKDD时事通讯探索。那个KDD国际会议也成为了数据挖掘领域质量最高的主要会议，其研究论文提交的接受率低于18%，而《数据挖掘与知识发现》也成为了该领域的主要研究期刊。&lt;br /&gt;
&lt;br /&gt;
==背景 Background==&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from [[data]] has occurred for centuries. Early methods of identifying patterns in data include [[Bayes' theorem]] (1700s) and [[regression analysis]] (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As [[data set]]s have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as [[neural networks]], [[cluster analysis]], [[genetic algorithms]] (1950s), [[decision tree learning|decision trees]] and [[decision rules]] (1960s), and [[support vector machines]] (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns&amp;lt;ref name=&amp;quot;Kantardzic&amp;quot;&amp;gt;{{cite book |last=Kantardzic |first=Mehmed |title=Data Mining: Concepts, Models, Methods, and Algorithms |year=2003 |publisher=John Wiley &amp;amp; Sons |isbn=978-0-471-22852-3 |oclc=50055336 |url-access=registration |url=https://archive.org/details/dataminingconcep0000kant }}&amp;lt;/ref&amp;gt; in large data sets. It bridges the gap from [[applied statistics]] and artificial intelligence (which usually provide the mathematical background) to [[database management]] by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from data has occurred for centuries. Early methods of identifying patterns in data include Bayes' theorem (1700s) and regression analysis (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As data sets have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as neural networks, cluster analysis, genetic algorithms (1950s), decision trees and decision rules (1960s), and support vector machines (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns in large data sets. It bridges the gap from applied statistics and artificial intelligence (which usually provide the mathematical background) to database management by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
从数据中手动提取模式的方法已经持续了好几个世纪了。早期识别数据模式的方法包括17世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;贝叶斯定理 Bayes' Theorem&amp;lt;/font&amp;gt;'''和19世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归分析 Regression Analysis&amp;lt;/font&amp;gt;'''。计算机技术的扩散、其普遍性和日益强大的能力极大地提高了数据的收集、存储和操作能力。随着数据集的规模和复杂性的增长，手动分析数据的方法越来越多地被更强的间接、自动化的数据处理所取代，这都得益于计算机科学其他领域取得的新的进步，特别是机器学习领域的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;神经网络 Neural Networks&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;遗传算法 Genetic Algorithms&amp;lt;/font&amp;gt;'''（1950年代），'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策树 Decision Tree&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策规则 Decision Rules&amp;lt;/font&amp;gt;'''（1960年代）以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;支持向量机 Support Vector Machines&amp;lt;/font&amp;gt;'''（1990年代）等。数据挖掘就是应用这些方法来发现大型数据集中的隐藏模式的过程。它利用数据在数据库中存储和索引的方式，更有效地执行实际的学习和发现算法，从而弥补了从应用统计学和人工智能(通常提供数学背景)到数据库管理之间的差距，使这些方法能够应用于更大的数据集。&lt;br /&gt;
&lt;br /&gt;
==发展过程 Process==&lt;br /&gt;
&lt;br /&gt;
The ''knowledge discovery in databases (KDD) process'' is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
The knowledge discovery in databases (KDD) process is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
数据库中的知识发现 Knowledge Discovery in Databases ，KDD过程通常定义为以下几个阶段:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Selection&lt;br /&gt;
&lt;br /&gt;
 Selection&lt;br /&gt;
&lt;br /&gt;
选择&lt;br /&gt;
&lt;br /&gt;
# Pre-processing&lt;br /&gt;
&lt;br /&gt;
 Pre-processing&lt;br /&gt;
&lt;br /&gt;
预处理&lt;br /&gt;
&lt;br /&gt;
# Transformation&lt;br /&gt;
&lt;br /&gt;
 Transformation&lt;br /&gt;
&lt;br /&gt;
转换&lt;br /&gt;
&lt;br /&gt;
# ''Data mining''&lt;br /&gt;
&lt;br /&gt;
 Data mining&lt;br /&gt;
&lt;br /&gt;
数据挖掘&lt;br /&gt;
&lt;br /&gt;
# Interpretation/evaluation.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
 Interpretation/evaluation.&lt;br /&gt;
&lt;br /&gt;
解释 / 评估。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the [[Cross-industry standard process for data mining]] (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the Cross-industry standard process for data mining (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
然而，它存在于这个主题的许多变体中，例如在'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘的跨行业标准流程 Cross-industry standard process for data mining，CRISP-DM&amp;lt;/font&amp;gt;'''中它定义了以下六个阶段：&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Business understanding&lt;br /&gt;
&lt;br /&gt;
 Business understanding&lt;br /&gt;
&lt;br /&gt;
商业理解&lt;br /&gt;
&lt;br /&gt;
# Data understanding&lt;br /&gt;
&lt;br /&gt;
 Data understanding&lt;br /&gt;
&lt;br /&gt;
数据理解&lt;br /&gt;
&lt;br /&gt;
# Data preparation&lt;br /&gt;
&lt;br /&gt;
 Data preparation&lt;br /&gt;
&lt;br /&gt;
数据准备&lt;br /&gt;
&lt;br /&gt;
# Modeling&lt;br /&gt;
&lt;br /&gt;
 Modeling&lt;br /&gt;
&lt;br /&gt;
建模&lt;br /&gt;
&lt;br /&gt;
# Evaluation&lt;br /&gt;
&lt;br /&gt;
 Evaluation&lt;br /&gt;
&lt;br /&gt;
评估&lt;br /&gt;
&lt;br /&gt;
# Deployment&lt;br /&gt;
&lt;br /&gt;
 Deployment&lt;br /&gt;
&lt;br /&gt;
部署&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
或一个简化的过程，包括：(1)预处理，(2)数据挖掘，(3)结果验证。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners.&amp;lt;ref&amp;gt;[[Gregory Piatetsky-Shapiro]] (2002) [http://www.kdnuggets.com/polls/2002/methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2004) [http://www.kdnuggets.com/polls/2004/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2007) [http://www.kdnuggets.com/polls/2007/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2014) [http://www.kdnuggets.com/polls/2014/analytics-data-mining-data-science-methodology.html ''KDnuggets Methodology Poll'']&amp;lt;/ref&amp;gt; The only other data mining standard named in these polls was [[SEMMA]]. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models,&amp;lt;ref name=&amp;quot;kurgan&amp;quot;&amp;gt;Lukasz Kurgan and Petr Musilek (2006); [http://journals.cambridge.org/action/displayAbstract?fromPage=online&amp;amp;aid=451120 ''A survey of Knowledge Discovery and Data Mining process models'']. The Knowledge Engineering Review. Volume 21 Issue 1, March 2006, pp&amp;amp;nbsp;1–24, Cambridge University Press, New York, NY, USA {{DOI|10.1017/S0269888906000737}}&amp;lt;/ref&amp;gt; and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&amp;lt;ref name=&amp;quot;AzevedoSantos&amp;quot;&amp;gt;Azevedo, A. and Santos, M. F. [http://www.iadis.net/dl/final_uploads/200812P033.pdf KDD, SEMMA and CRISP-DM: a parallel overview] {{webarchive|url=https://web.archive.org/web/20130109114939/http://www.iadis.net/dl/final_uploads/200812P033.pdf |date=2013-01-09 }}. In Proceedings of the IADIS European Conference on Data Mining 2008, pp&amp;amp;nbsp;182–185.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners. The only other data mining standard named in these polls was SEMMA. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models, and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&lt;br /&gt;
&lt;br /&gt;
在这些调查中，唯一的其他数据挖掘标准是SEMMA。然而，使用CRISP-DM的人数是其3-4倍。一些研究小组已经发表了关于数据挖掘过程模型的研究，例如阿泽维多 Azevedo和 桑托斯Santos曾在2008年对CRISP-DM和SEMMA这两套数据挖掘流程标准进行了比较。&lt;br /&gt;
&lt;br /&gt;
===预处理 Pre-processing===&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a [[data mart]] or [[data warehouse]]. Pre-processing is essential to analyze the [[Multivariate statistics|multivariate]] data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing [[statistical noise|noise]] and those with [[missing data]].&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a data mart or data warehouse. Pre-processing is essential to analyze the multivariate data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing noise and those with missing data.&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须先对目标数据集进行整合。由于数据挖掘只能发现数据中实际存在的模式，目标数据集必须足够大以包含这些模式，同时保持足够简洁以便在可接受的时间限制内进行挖掘。数据的公共源是数据集市或数据仓库。在数据挖掘之前，对多变量数据集进行预处理是必不可少的。然后清理目标集。数据清理去除了包含噪声的观测值和缺失数据的观测值。&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须组装目标数据集。由于数据挖掘只能发现数据中实际存在的模式，因此目标数据集必须足够大以包含这些模式，同时保持足够简洁，以便在可接受的时间限制内进行挖掘。数据的常见来源是'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据集市 Data Mart&amp;lt;/font&amp;gt;'''或'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据仓库 Data Warehouse&amp;lt;/font&amp;gt;'''。在数据挖掘之前，对'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;多元 Multivariate&amp;lt;/font&amp;gt;'''数据集进行预处理是必不可少的，然后对目标集进行清洗。数据清洗将删除包含'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;噪声 Noise&amp;lt;/font&amp;gt;'''的观测值和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;缺失数据 Missing Data&amp;lt;/font&amp;gt;'''的观测值。&lt;br /&gt;
&lt;br /&gt;
===数据挖掘 Data mining===&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&amp;lt;ref name=&amp;quot;Fayyad&amp;quot;&amp;gt;{{cite web |last1=Fayyad |first1=Usama |authorlink1=Usama Fayyad |last2=Piatetsky-Shapiro |first2=Gregory|authorlink2=Gregory Piatetsky-Shapiro |last3=Smyth |first3=Padhraic |title=From Data Mining to Knowledge Discovery in Databases |year=1996 |url=http://www.kdnuggets.com/gpspubs/aimag-kdd-overview-1996-Fayyad.pdf |accessdate = 17 December 2008 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&lt;br /&gt;
&lt;br /&gt;
数据挖掘涉及六类常见的任务:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection]] (outlier/change/deviation detection) – The identification of unusual data records, that might be interesting or data errors that require further investigation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly detection&amp;lt;/font&amp;gt;'''（异常值/变化/偏差检测）：识别异常数据记录，发现可能是有趣的或需要进一步调查的数据错误。&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]] (dependency modeling) – Searches for relationships between variables. For example, a supermarket might gather data on customer purchasing habits. Using association rule learning, the supermarket can determine which products are frequently bought together and use this information for marketing purposes. This is sometimes referred to as market basket analysis.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则学习 Association rule learning&amp;lt;/font&amp;gt;'''（依赖关系建模）：探变量之间的关系。例如，超市可能会收集顾客购买习惯的数据。通过使用关联规则学习，超市可以确定哪些产品经常被一起购买，并将这些信息用于营销策略改进。这种研究有时被称为“市场篮子分析”。&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis|Clustering]] – is the task of discovering groups and structures in the data that are in some way or another &amp;quot;similar&amp;quot;, without using known structures in the data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类 Clustering&amp;lt;/font&amp;gt;'''：是指在数据中发现以某种方式或其他方式“相似”的组和结构，而不使用数据中已知的结构。&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]] – is the task of generalizing known structure to apply to new data. For example, an e-mail program might attempt to classify an e-mail as &amp;quot;legitimate&amp;quot; or as &amp;quot;spam&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;分类 Classification&amp;lt;/font&amp;gt;'''：是将已知结构归纳为新数据的任务。例如，电子邮件程序可能会尝试将电子邮件分类为“合法”或“垃圾邮件”。&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis|Regression]] – attempts to find a function that models the data with the least error that is, for estimating the relationships among data or datasets.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归&amp;lt;/font&amp;gt;'''：试图找到一个对数据建模误差最小的函数，也就是说，用于估计数据或数据集之间的关系。&lt;br /&gt;
&lt;br /&gt;
* [[Automatic summarization|Summarization]] – providing a more compact representation of the data set, including visualization and report generation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;自动文摘 Automatic summarizatio&amp;lt;/font&amp;gt;'''：提供数据集更紧凑、简洁的表示，包括可视化和报告生成。&lt;br /&gt;
&lt;br /&gt;
===结果验证 Results validation===&lt;br /&gt;
&lt;br /&gt;
[[File:Spurious correlations - spelling bee spiders.svg|thumb|An example of data produced by [[data dredging]] through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence. 一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。]]&lt;br /&gt;
&lt;br /&gt;
An example of data produced by data dredging through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence.&lt;br /&gt;
&lt;br /&gt;
一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be [[Reproducibility|reproduced]] on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper [[statistical hypothesis testing]]. A simple version of this problem in [[machine learning]] is known as [[overfitting]], but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&amp;lt;ref name=hawkins&amp;gt;{{cite journal | last1 = Hawkins | first1 = Douglas M | year = 2004 | title = The problem of overfitting | url = | journal = Journal of Chemical Information and Computer Sciences | volume = 44 | issue = 1| pages = 1–12 | doi=10.1021/ci0342472| pmid = 14741005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be reproduced on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper statistical hypothesis testing. A simple version of this problem in machine learning is known as overfitting, but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&lt;br /&gt;
&lt;br /&gt;
数据挖掘可能会在无意中被误用，然后产生看似重要的结果; 但这些结果实际上并不能用来预测未来的行为，也不能在新的数据样本上进行复现，而且用处不大。这通常是由于调查了太多的假设，而没有进行适当的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;统计假设检验 Statistical Hypothesis Testing&amp;lt;/font&amp;gt;'''。在机器学习中，这种问题可以被简称为'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''，但相同的问题可能会在过程的不同阶段出现，因此，在完全适用的情况下，合理进行训练/测试分割这一种方法可能不足以防止这种情况的发生。&lt;br /&gt;
&lt;br /&gt;
{{Missing information|section|non-classification tasks in data mining. It only covers [[machine learning]]|date=September 2011}}&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called [[overfitting]]. To overcome this, the evaluation uses a [[test set]] of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a [[training set]] of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had ''not'' been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as [[Receiver operating characteristic|ROC curves]].&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called overfitting. To overcome this, the evaluation uses a test set of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a training set of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had not been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as ROC curves.&lt;br /&gt;
&lt;br /&gt;
从数据中发现知识的最后一步是验证数据挖掘算法产生的模式是否存在于更广泛的数据集中。数据挖掘算法发现的并非所有模式都是有效的，因为对于数据挖掘算法来说，在训练集中发现一般数据集中没有的模式是很常见的，这叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''。为了克服这个问题，评估使用一组测试数据，而数据挖掘算法并没有在这些测试数据上进行训练。然后将学习到的模式应用到这个'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;测试集 Test Set&amp;lt;/font&amp;gt;'''中，并将结果输出与期望的输出进行比较。例如，试图区分“垃圾邮件”和“合法”邮件的数据挖掘算法将根据一组电子邮件'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;训练集 Training Sett&amp;lt;/font&amp;gt;'''样本进行训练。训练完毕后，学到的模式将应用于未经训练的那部分电子邮件测试集数据上。然后，可以从这些模式正确分类的电子邮件数量来衡量这些模式的准确性。可以使用几种统计方法可以用来评估算法，如'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;ROC 曲线 ROC curves&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
如果学习的模式不能达到预期的标准，那么就需要重新评估和修改预处理和数据挖掘的步骤。如果所学的模式确实符合所需的标准，那么最后一步就是对习得的模式进行解释并将其转化为知识。&lt;br /&gt;
&lt;br /&gt;
==研究 Research==&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the [[Association for Computing Machinery]]'s (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining ([[SIGKDD]]).&amp;lt;ref&amp;gt;{{cite web|url=http://academic.research.microsoft.com/?SearchDomain=2&amp;amp;SubDomain=7&amp;amp;entitytype=2|title=Microsoft Academic Search: Top conferences in data mining | publisher=[[Microsoft Academic Search]]}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|url=https://scholar.google.de/citations?view_op=top_venues&amp;amp;hl=en&amp;amp;vq=eng_datamininganalysis|title=Google Scholar: Top publications - Data Mining &amp;amp; Analysis|publisher=[[Google Scholar]]}}&amp;lt;/ref&amp;gt; Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings,&amp;lt;ref&amp;gt;[http://www.kdd.org/conferences.php Proceedings] {{Webarchive|url=https://web.archive.org/web/20100430120252/http://www.kdd.org/conferences.php |date=2010-04-30 }}, International Conferences on Knowledge Discovery and Data Mining, ACM, New York.&amp;lt;/ref&amp;gt; and since 1999 it has published a biannual [[academic journal]] titled &amp;quot;SIGKDD Explorations&amp;quot;.&amp;lt;ref&amp;gt;[http://www.kdd.org/explorations/about.php SIGKDD Explorations], ACM, New York.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the Association for Computing Machinery's (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining (SIGKDD). Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings, and since 1999 it has published a biannual academic journal titled &amp;quot;SIGKDD Explorations&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
该领域的首要专业机构是计算机协会 ACM的知识发现和数据挖掘特别兴趣小组 SIGKDD。自1989年以来，ACM SIG每年举办一次国际会议并出版会议记录，自1999年起，它还出版了一份名为“SIGKDD探索”的两年期学术期刊。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
关于数据挖掘的计算机科学会议包括:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[CIKM Conference]] – ACM [[Conference on Information and Knowledge Management]]&lt;br /&gt;
&lt;br /&gt;
CIKM会议 ：ACM'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;信息和知识管理会议 Conference on Information and Knowledge Management&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
* [[European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases]]&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;欧洲机器学习与数据库知识发现原理与实践会议 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
* [[KDD Conference]] – ACM SIGKDD [[Conference on Knowledge Discovery and Data Mining]]&lt;br /&gt;
&lt;br /&gt;
KDD会议：ACM SIGKDD的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;知识发现与数据挖掘会议 Conference on Knowledge Discovery and Data Mining&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many [[List of computer science conferences#Data Management|data management/database conferences]] such as the ICDE Conference, [[SIGMOD|SIGMOD Conference]] and [[International Conference on Very Large Data Bases]]&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many data management/database conferences such as the ICDE Conference, SIGMOD Conference and International Conference on Very Large Data Bases.&lt;br /&gt;
&lt;br /&gt;
数据挖掘专题也出现在许多数据管理/数据库会议上，如 ICDE会议、 '''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;SIGMOD会议 SIGMOD Conference&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关于超大数据库国际会议International Conference on Very Large Data Bases&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
==标准 Standards==&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European [[Cross Industry Standard Process for Data Mining]] (CRISP-DM 1.0) and the 2004 [[Java Data Mining]] standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European Cross Industry Standard Process for Data Mining (CRISP-DM 1.0) and the 2004 Java Data Mining standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
为数据挖掘过程定义了一些标准，例如1999年欧洲跨行业数据挖掘标准流程（CRISP-DM 1.0）和2004年Java数据挖掘标准（JDM 1.0）。这些程序的后续程序（CRISP-DM 2.0和 JDM 2.0）的开发活跃于2006年，但此后一直停滞不前。Jdm 2.0没有达成最终草案就被撤销了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in [[predictive analytics]]&amp;amp;nbsp;– the key standard is the [[Predictive Model Markup Language]] (PMML), which is an [[XML]]-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) [[subspace clustering]] have been proposed independently of the DMG.&amp;lt;ref&amp;gt;{{Cite book | last1 = Günnemann | first1 = Stephan | last2 = Kremer | first2 = Hardy | last3 = Seidl | first3 = Thomas | doi = 10.1145/2023598.2023605 | chapter = An extension of the PMML standard to subspace clustering models | title = Proceedings of the 2011 workshop on Predictive markup language modeling - PMML '11 | pages = 48 | year = 2011 | isbn = 978-1-4503-0837-3 | pmid =  | pmc = }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in predictive analytics&amp;amp;nbsp;– the key standard is the Predictive Model Markup Language (PMML), which is an XML-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) subspace clustering have been proposed independently of the DMG.&lt;br /&gt;
&lt;br /&gt;
为了交换所提取的模型，特别是在预测分析中使用，关键的标准是预测模型标记语言 PMML，这是一种基于 XML 的语言，由数据挖掘集团 DMG 开发，并支持作为交换格式的许多数据挖掘应用程序。顾名思义，它只涵盖预测模型，这是一项对业务应用程序非常重要的特殊数据挖掘任务。然而，覆盖子空间聚类的扩展已经独立于 DMG 被提出。&lt;br /&gt;
&lt;br /&gt;
==显著用途 Notable uses==&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable [[examples of data mining]] can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable examples of data mining can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
数据挖掘在任何有数字数据可用的地方都可以被使用。数据挖掘的著名例子可以在商业、医学、科学和监控领域找到。&lt;br /&gt;
&lt;br /&gt;
==隐私问题和道德规范 Privacy concerns and ethics==&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&amp;lt;ref&amp;gt;{{cite journal |author=Seltzer, William |title=The Promise and Pitfalls of Data Mining: Ethical Issues |url=https://ww2.amstat.org/committees/ethics/linksdir/Jsm2005Seltzer.pdf|publisher = American Statistical Association|journal = ASA Section on Government Statistics|date = 2005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&lt;br /&gt;
&lt;br /&gt;
虽然“数据挖掘”这个术语本身可能没有伦理含义，但它通常与人们行为（伦理和其他）相关的信息挖掘有关。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding [[privacy]], legality, and ethics.&amp;lt;ref&amp;gt;{{cite journal |author=Pitts, Chip |title=The End of Illegal Domestic Spying? Don't Count on It |url=http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |journal=Washington Spectator |date=15 March 2007 |url-status=dead |archiveurl=https://web.archive.org/web/20071128015201/http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |archivedate=2007-11-28 }}&amp;lt;/ref&amp;gt; In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the [[Total Information Awareness]] Program or in [[ADVISE]], has raised privacy concerns.&amp;lt;ref&amp;gt;{{cite journal |author=Taipale, Kim A. |title=Data Mining and Domestic Security: Connecting the Dots to Make Sense of Data |url=http://www.stlr.org/cite.cgi?volume=5&amp;amp;article=2 |journal=Columbia Science and Technology Law Review |volume=5 |issue=2 |date=15 December 2003 |ssrn=546782 |oclc=45263753 }}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|last1=Resig|first1=John|title=A Framework for Mining Instant Messaging Services|url=https://johnresig.com/files/research/SIAMPaper.pdf|accessdate=16 March 2018}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding privacy, legality, and ethics. In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the Total Information Awareness Program or in ADVISE, has raised privacy concerns.&lt;br /&gt;
&lt;br /&gt;
在某些情况下，数据挖掘的使用方式可能会引发隐私、合法性和伦理问题。特别是，为国家安全或执法目的而进行的政府或商业数据集的数据挖掘，如在全面信息意识项目或在 ADVISE 中，引起了隐私问题。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through [[aggregate function|data aggregation]]. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent).&amp;lt;ref name=&amp;quot;NASCIO&amp;quot;&amp;gt;[http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf ''Think Before You Dig: Privacy Implications of Data Mining &amp;amp; Aggregation''] {{webarchive|url=https://web.archive.org/web/20081217063043/http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf |date=2008-12-17 }}, NASCIO Research Brief, September 2004&amp;lt;/ref&amp;gt; This is not data mining ''per se'', but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&amp;lt;ref&amp;gt;{{cite magazine |first=Paul |last=Ohm |title=Don't Build a Database of Ruin |magazine=Harvard Business Review |url=http://blogs.hbr.org/cs/2012/08/dont_build_a_database_of_ruin.html}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/12/03/iron-cagebook/ Iron Cagebook - The Logical End of Facebook's Patents], [[Counterpunch.org]], 2013.12.03&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/09/11/inside-the-tech-industrys-startup-conference/ Inside the Tech industry's Startup Conference], [[Counterpunch.org]], 2013.09.11&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through data aggregation. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent). This is not data mining per se, but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&lt;br /&gt;
&lt;br /&gt;
数据挖掘需要进行数据准备，以发现损害机密性和隐私义务的信息或模式。实现这一点的一种常见方式是通过'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据聚合 Data Aggregation&amp;lt;/font&amp;gt;'''。数据聚合包括以一种便于分析的方式将数据（可能来自不同的来源）组合在一起（但这也可能使私人、个人级别的数据的识别变得可推断或以其他方式显而易见）。但这并不是数据挖掘本身，而是在分析之前以及为分析目的准备数据的结果。当数据被编译后，数据挖掘者或任何有权访问新编译的数据集的人能够识别特定的个人，特别是当数据最初是匿名的时，对个人隐私的威胁就开始发挥作用了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It is recommended{{whom|date=August 2019}} to be aware of the following '''before''' data are collected:&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
It is recommended to be aware of the following before data are collected:&lt;br /&gt;
&lt;br /&gt;
在收集数据之前，建议注意以下事项:&lt;br /&gt;
&lt;br /&gt;
* The purpose of the data collection and any (known) data mining projects;&lt;br /&gt;
&lt;br /&gt;
数据收集和任何（已知的）数据挖掘项目的目的；&lt;br /&gt;
&lt;br /&gt;
* How the data will be used;&lt;br /&gt;
&lt;br /&gt;
数据使用的方法；&lt;br /&gt;
&lt;br /&gt;
* Who will be able to mine the data and use the data and their derivatives;&lt;br /&gt;
&lt;br /&gt;
谁将能够挖掘数据并使用这些数据及其衍生工具；&lt;br /&gt;
&lt;br /&gt;
* The status of security surrounding access to the data;&lt;br /&gt;
&lt;br /&gt;
数据访问的安全状态；&lt;br /&gt;
&lt;br /&gt;
* How collected data can be updated.&lt;br /&gt;
&lt;br /&gt;
如何更新收集的数据。&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to ''become'' anonymous, so that individuals may not readily be identified.&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt; However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&amp;lt;ref&amp;gt;[http://www.securityfocus.com/brief/277 ''AOL search data identified individuals''], SecurityFocus, August 2006&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to become anonymous, so that individuals may not readily be identified.However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&lt;br /&gt;
&lt;br /&gt;
数据也可以被修改成匿名的，这样个人就不容易被修改了确定。但是，甚至“匿名化”的数据集也可能包含足够的信息用来识别个人，就像记者能够根据一组无意中搜索历史找到几个个人一样美国在线发布。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of [[personally identifiable information]] leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of [[privacy violation]], the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&amp;lt;ref&amp;gt;{{Cite journal|title = Big data׳s impact on privacy, security and consumer welfare|journal = Telecommunications Policy|pages = 1134–1145|volume = 38|issue = 11|doi = 10.1016/j.telpol.2014.10.002|first = Nir|last = Kshetri|year = 2014|url = http://libres.uncg.edu/ir/uncg/f/N_Kshetri_Big_2014.pdf}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of personally identifiable information leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of privacy violation, the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
无意中泄露个人身份信息导致提供者违反了公平信息惯例。这种轻率的行为会对指定的个人造成经济、情感或身体伤害。在一起侵犯隐私的案例中，沃尔格林 Walgreens的赞助人在2011年对该公司提起诉讼，指控该公司向数据挖掘公司出售处方信息，而数据挖掘公司又将这些数据提供给制药公司。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲的情况 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[European Union|Europe]] has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the [[International Safe Harbor Privacy Principles|U.S.-E.U. Safe Harbor Principles]], developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of [[Edward Snowden]]'s [[global surveillance disclosure]], there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the [[National Security Agency]], and attempts to reach an agreement with the United States have failed.&amp;lt;ref&amp;gt;{{cite web |url=https://crsreports.congress.gov/product/pdf/R/R44257/7 |title=U.S.-E.U. Data Privacy: From Safe Harbor to Privacy Shield |last1=Weiss |first1=Martin A. |last2=Archick |first2=Kristin |date=19 May 2016 |department= |website= |series= |agency=Congressional Research Service |location=Washington, D.C. |page=6 |pages= |format=PDF |id=R44257 |access-date=9 April 2020 |quote=On October 6, 2015, the [[Court of Justice of the European Union|CJEU]]&amp;amp;nbsp;... issued a decision that invalidated Safe Harbor (effective immediately), as currently implemented. }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Europe has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the U.S.-E.U. Safe Harbor Principles, developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of Edward Snowden's global surveillance disclosure, there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the National Security Agency, and attempts to reach an agreement with the United States have failed.&lt;br /&gt;
&lt;br /&gt;
欧洲有相当强的隐私法，正在努力进一步加强消费者的权利。然而，1998年至2000年期间制定的《美国-欧盟安全港原则》（U.S.-E.U.Safe Harbor Principles）目前有效地使欧洲用户受到美国公司的隐私剥削。由于爱德华·斯诺登 Edward Snowden披露了全球监控信息后，关于撤销这一协议的讨论越来越多，尤其是数据将完全暴露给国家安全局，与美国达成协议的尝试也失败了。&lt;br /&gt;
&lt;br /&gt;
===美国的情况 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the [[US Congress]] via the passage of regulatory controls such as the [[Health Insurance Portability and Accountability Act]] (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in ''Biotech Business Week'', &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot;&amp;lt;ref&amp;gt;Biotech Business Week Editors (June 30, 2008); ''BIOMEDICINE; HIPAA Privacy Rule Impedes Biomedical Research'', Biotech Business Week, retrieved 17 November 2009 from LexisNexis Academic&amp;lt;/ref&amp;gt; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the US Congress via the passage of regulatory controls such as the Health Insurance Portability and Accountability Act (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in Biotech Business Week, &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
在美国，美国国会通过了《健康保险便携性和责任法案》（HIPAA）等监管措施，解决了隐私问题。HIPAA要求个人就其提供的信息及其当前和未来的预期用途给予“知情同意”。根据《生物技术商业周刊》的一篇文章，“在实践中，HIPAA可能不会比研究领域长期存在的法规提供更大的保护。”。更重要的是，该规则通过知情同意进行保护的目标是接近普通个人的不可理解程度。”这突出了数据聚合和挖掘实践中数据匿名的必要性。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the [[Family Educational Rights and Privacy Act]] (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the Family Educational Rights and Privacy Act (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
美国信息隐私立法，如 HIPAA 和《家庭教育权利和隐私法》（FERPA）仅适用于每一个此类法律所涉及的特定领域。美国大多数企业对数据挖掘的使用并不受任何法律的控制。&lt;br /&gt;
&lt;br /&gt;
== 数据挖掘与著作权法 Copyright law==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Under [[Copyright law of the European Union|European copyright]] and [[Database Directive|database law]]s, the mining of in-copyright works (such as by [[web mining]]) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright{{snd}} but database rights may exist so data mining becomes subject to [[intellectual property]] owners' rights that are protected by the [[Database Directive]]. On the recommendation of the [[Hargreaves review]], this led to the UK government to amend its copyright law in 2014 to allow content mining as a [[Limitations and exceptions to copyright|limitation and exception]].&amp;lt;ref&amp;gt;[http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ UK Researchers Given Data Mining Right Under New UK Copyright Laws.] {{webarchive |url=https://web.archive.org/web/20140609020315/http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ |date=June 9, 2014 }} ''Out-Law.com.''   Retrieved 14 November 2014&amp;lt;/ref&amp;gt; The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the [[Information Society Directive]] (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
Under European copyright and database laws, the mining of in-copyright works (such as by web mining) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright but database rights may exist so data mining becomes subject to intellectual property owners' rights that are protected by the Database Directive. On the recommendation of the Hargreaves review, this led to the UK government to amend its copyright law in 2014 to allow content mining as a limitation and exception. The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the Information Society Directive (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
根据欧洲版权法和数据库法，未经版权所有人许可而对版权作品进行挖掘（如通过网络挖掘）是不合法的。在欧洲，如果数据库是纯数据，可能没有版权，但数据库权利可能存在，因此数据挖掘受数据库指令保护的知识产权所有者的权利约束。根据《哈格里夫斯评论》（Hargreaves review）的建议，这导致英国政府在2014年修订了版权法，允许将内容挖掘作为一种限制和例外。英国是继日本之后世界上第二个这样做的国家，日本在2009年引入了数据挖掘的例外。然而，由于信息社会指令（2001年）的限制，英国是例外情况但是只允许非商业目的的内容挖掘。英国版权法也不允许合同条款和条件推翻这一规定。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The [[European Commission]] facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe.&amp;lt;ref&amp;gt;{{cite web|title=Licences for Europe - Structured Stakeholder Dialogue 2013|url=http://ec.europa.eu/licences-for-europe-dialogue/en/content/about-site|website=European Commission|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt; The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and [[open access]] publishers to leave the stakeholder dialogue in May 2013.&amp;lt;ref&amp;gt;{{cite web|title=Text and Data Mining:Its importance and the need for change in Europe|url=http://libereurope.eu/news/text-and-data-mining-its-importance-and-the-need-for-change-in-europe/|website=Association of European Research Libraries|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The European Commission facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe. The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and open access publishers to leave the stakeholder dialogue in May 2013.&lt;br /&gt;
&lt;br /&gt;
2013年，欧盟委员会以“欧洲许可证”为题，推动了利益相关者对文本和数据挖掘的讨论。但他们将重点放在解决这一法律问题上，如许可证而不是限制和例外，导致大学、研究人员、图书馆、民间社会团体和开放获取出版商的代表于2013年5月离开了利益相关者对话。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===美国 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Copyright law of the United States|US copyright law]], and in particular its provision for [[fair use]], upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the [[Google Book Search Settlement Agreement|Google Book settlement]] the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&amp;lt;ref&amp;gt;{{cite web|title=Judge grants summary judgment in favor of Google Books — a fair use victory|url=http://www.lexology.com/library/detail.aspx?g=a18c5b92-5a20-4d1d-a098-a3095046a88e|website=Lexology.com|publisher=Antonelli Law Ltd|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
US copyright law, and in particular its provision for fair use, upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the Google Book settlement the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&lt;br /&gt;
&lt;br /&gt;
美国版权法，特别是其中关于合理使用的条款，支持在美国和其他合理使用国家，如以色列，台湾和韩国采矿内容的合法性。由于内容挖掘是变革性的，也就是说，它不会取代原来的工作，它被视为合法的合理使用。例如，作为谷歌图书和解协议的一部分，此案的主审法官裁定，谷歌版权图书数字化项目是合法的，部分原因在于数字化项目所展示的变革性用途——其中之一就是文本和数据挖掘。&lt;br /&gt;
&lt;br /&gt;
==软件 Software==&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Data mining and machine learning software}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===开源的数据挖掘软件 Free open-source data mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以使用免费 / 开源许可证。应用程序源代码也是对公众开放访问的。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Carrot2]]: Text and search results clustering framework.  文本和搜索结果聚类框架。&lt;br /&gt;
&lt;br /&gt;
* [[Chemicalize.org]]: A chemical structure miner and web search engine.  化学结构挖掘与网络搜索引擎。&lt;br /&gt;
&lt;br /&gt;
* [[ELKI]]: A university research project with advanced [[cluster analysis]] and [[anomaly detection|outlier detection]] methods written in the [[Java (programming language)|Java]] language.  一个大学研究项目，用Java语言编写高级聚类分析和离群点检测方法。&lt;br /&gt;
&lt;br /&gt;
* [[General Architecture for Text Engineering|GATE]]: a [[natural language processing]] and language engineering tool.  一个自然语言处理和语言工程工具。&lt;br /&gt;
&lt;br /&gt;
* [[KNIME]]: The Konstanz Information Miner, a user-friendly and comprehensive data analytics framework.  Konstanz Information Miner，一个用户友好的综合数据分析框架。&lt;br /&gt;
&lt;br /&gt;
* [[MOA (Massive Online Analysis)|Massive Online Analysis (MOA)]]: a real-time big data stream mining with concept drift tool in the [[Java (programming language)|Java]] programming language.  利用Java语言中的概念漂移工具进行实时大数据流挖掘。&lt;br /&gt;
&lt;br /&gt;
* [[Multi expression programming|MEPX]] - cross-platform tool for regression and classification problems based on a Genetic Programming variant.  基于遗传编程变量的回归和分类问题的跨平台工具。&lt;br /&gt;
&lt;br /&gt;
* ML-Flex: A software package that enables users to integrate with third-party machine-learning packages written in any programming language, execute classification analyses in parallel across multiple computing nodes, and produce HTML reports of classification results.  一种软件包，使用户能够与用任何编程语言编写的第三方机器学习包集成，跨多个计算节点并行执行分类分析，并生成分类结果的HTML报告。&lt;br /&gt;
&lt;br /&gt;
* [[mlpack]]: a collection of ready-to-use machine learning algorithms written in the [[C++]] language. 一个用C++语言编写的机器学习算法的集合。&lt;br /&gt;
&lt;br /&gt;
* [[NLTK]] ([[Natural Language Toolkit]]): A suite of libraries and programs for symbolic and statistical natural language processing (NLP) for the [[Python (programming language)|Python]] language.  一套用于Python语言的符号和统计自然语言处理（NLP）的库和程序。&lt;br /&gt;
&lt;br /&gt;
* [[OpenNN]]: Open [[neural networks]] library.  开源的神经网络库。&lt;br /&gt;
&lt;br /&gt;
* [[Orange (software)|Orange]]: A component-based data mining and [[machine learning]] software suite written in the [[Python (programming language)|Python]] language. 一个用Python语言编写的基于组件的数据挖掘和机器学习软件套件。&lt;br /&gt;
&lt;br /&gt;
* [[R (programming language)|R]]: A [[programming language]] and software environment for [[statistics|statistical]] computing, data mining, and graphics. It is part of the [[GNU Project]]. 一种用于统计计算、数据挖掘和图形的编程语言和软件环境。它是GNU项目的一部分。&lt;br /&gt;
&lt;br /&gt;
* [[scikit-learn]] is an open-source machine learning library for the Python programming language  是Python编程语言的一个开源机器学习库&lt;br /&gt;
&lt;br /&gt;
* [[Torch (machine learning)|Torch]]: An [[open source model|open-source]] [[deep learning]] library for the [[Lua (programming language)|Lua]] programming language and [[scientific computing]] framework with wide support for [[machine learning]] algorithms.  一个开源的深度学习lib库语言和科学计算框架，广泛支持机器学习算法。&lt;br /&gt;
&lt;br /&gt;
* [[UIMA]]: The UIMA (Unstructured Information Management Architecture) is a component framework for analyzing unstructured content such as text, audio and video – originally developed by IBM.  UIMA（非结构化信息管理体系结构）是一个用于分析非结构化内容（如文本、音频和视频）的组件框架，最初由IBM开发。&lt;br /&gt;
&lt;br /&gt;
* [[Weka (machine learning)|Weka]]: A suite of machine learning software applications written in the [[Java (programming language)|Java]] programming language.  用Java编程语言编写的一套机器学习软件应用程序。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===需要专有许可的数据挖掘软件和应用程序 Proprietary data-mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以根据专有许可证提供。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Angoss]] KnowledgeSTUDIO: data mining tool  数据挖掘工具。&lt;br /&gt;
&lt;br /&gt;
* [[LIONsolver]]: an integrated software application for data mining, business intelligence, and modeling that implements the Learning and Intelligent OptimizatioN (LION) approach.  用于数据挖掘、商业智能和建模的集成软件应用程序，实现学习和智能优化（LION）方法。&lt;br /&gt;
&lt;br /&gt;
* Megaputer Intelligence: data and text mining software is called PolyAnalyst.  数据和文本挖掘软件PolyAnalyst。&lt;br /&gt;
&lt;br /&gt;
* [[Microsoft Analysis Services]]: data mining software provided by [[Microsoft]].  微软提供的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[NetOwl]]: suite of multilingual text and entity analytics products that enable data mining.  支持数据挖掘的多语言文本和实体分析产品套件。&lt;br /&gt;
&lt;br /&gt;
* [[Oracle Data Mining]]: data mining software by [[Oracle Corporation]].  Oracle公司的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[PSeven]]: platform for automation of engineering simulation and analysis, multidisciplinary optimization and data mining provided by [[DATADVANCE]].  DATADVANCE为工程仿真分析、多学科优化和数据挖掘提供自动化平台。&lt;br /&gt;
&lt;br /&gt;
* [[Qlucore]] Omics Explorer: data mining software.  数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[RapidMiner]]: An environment for [[machine learning]] and data mining experiments. &amp;lt;!-- Latest version is NOT opensource --&amp;gt;  一个用于机器学习和数据挖掘实验的环境。&lt;br /&gt;
&lt;br /&gt;
* [[SAS (software)#Components|SAS Enterprise Miner]]: data mining software provided by the [[SAS Institute]].  SAS机构提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[SPSS Modeler]]: data mining software provided by [[IBM]].  IBM提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[STATISTICA]] Data Miner: data mining software provided by [[StatSoft]].  StatSoft提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[Tanagra (machine learning)|Tanagra]]: Visualisation-oriented data mining software, also for teaching.  面向可视化的数据挖掘软件，也用于教学。&lt;br /&gt;
&lt;br /&gt;
* [[Vertica]]: data mining software provided by [[Hewlett-Packard]].  惠普提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
==扩展链接 See also==&lt;br /&gt;
&lt;br /&gt;
; Methods&lt;br /&gt;
&lt;br /&gt;
方法&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Agent mining]]  主体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection|Anomaly/outlier/change detection]]  异常/异常/变化检测&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]]  关联规则学习&lt;br /&gt;
&lt;br /&gt;
* [[Bayesian network]]s  贝叶斯网络&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]]  分类&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis]]  聚类分析&lt;br /&gt;
&lt;br /&gt;
* [[Decision tree]]s  决策树&lt;br /&gt;
&lt;br /&gt;
* [[Ensemble learning]]  集成学习&lt;br /&gt;
&lt;br /&gt;
* [[Factor analysis]]  因子分析&lt;br /&gt;
&lt;br /&gt;
* [[Genetic algorithms]]  遗传算法&lt;br /&gt;
&lt;br /&gt;
* [[Intention mining]]  意向玩具&lt;br /&gt;
&lt;br /&gt;
* [[Learning classifier system]]  学习分类器系统&lt;br /&gt;
&lt;br /&gt;
* [[Multilinear subspace learning]]  多线性子空间学习&lt;br /&gt;
&lt;br /&gt;
* [[Artificial neural network|Neural network]]s  神经网络&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis]]  回归分析&lt;br /&gt;
&lt;br /&gt;
* [[Sequence mining]]   序列挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Structured data analysis (statistics)|Structured data analysis]]  结构数据学习&lt;br /&gt;
&lt;br /&gt;
* [[Support vector machines]]  支持向量机&lt;br /&gt;
&lt;br /&gt;
* [[Text mining]]  文本挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Time series|Time series analysis]]  时间序列分析&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application domains&lt;br /&gt;
&lt;br /&gt;
应用领域&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Analytics]] 分析&lt;br /&gt;
&lt;br /&gt;
* [[Behavior informatics]]  行为信息学&lt;br /&gt;
&lt;br /&gt;
* [[Big Data|Big data]]  大数据&lt;br /&gt;
&lt;br /&gt;
* [[Bioinformatics]]  生物信息学&lt;br /&gt;
&lt;br /&gt;
* [[Business intelligence]]  商务智能&lt;br /&gt;
&lt;br /&gt;
* [[Data analysis]]  数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Data warehouse]]  数据仓库&lt;br /&gt;
&lt;br /&gt;
* [[Decision support system]]  决策支持系统&lt;br /&gt;
&lt;br /&gt;
* [[Domain driven data mining]]  域驱动的数据挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Drug discovery]]  药物发现&lt;br /&gt;
&lt;br /&gt;
* [[Exploratory data analysis]]  探索性数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Predictive analytics]]  预测分析&lt;br /&gt;
&lt;br /&gt;
* [[Web mining]]  网页挖掘&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application examples&lt;br /&gt;
&lt;br /&gt;
应用示例&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|=&lt;br /&gt;
&lt;br /&gt;
*[[Automatic number plate recognition in the United Kingdom#Data mining|Automatic number plate recognition in the United Kingdom]]  英国的自动车牌识别&lt;br /&gt;
&lt;br /&gt;
*[[Customer analytics#Data mining|Customer analytics]]  客户分析&lt;br /&gt;
&lt;br /&gt;
*[[Educational data mining]]  教育数据挖掘&lt;br /&gt;
&lt;br /&gt;
*[[National Security Agency#Transaction data mining|National Security Agency]]  国家安全局&lt;br /&gt;
&lt;br /&gt;
*[[Quantitative structure–activity relationship#Data mining approach|Quantitative structure–activity relationship]]  数量结构-活动关系&lt;br /&gt;
&lt;br /&gt;
*[[Surveillance#Data mining and profiling|Surveillance]] / [[Mass surveillance#Data mining|Mass surveillance]] (e.g., [[Stellar Wind (code name)|Stellar Wind]])&lt;br /&gt;
监控/大规模监测（例如，恒星风）&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Related topics&lt;br /&gt;
&lt;br /&gt;
相关话题&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to ''analyzing'' data) , see:&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to analyzing data) , see:&lt;br /&gt;
&lt;br /&gt;
有关从数据中提取信息(与分析数据相反)的详细信息，请参阅:&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Data integration]]  数据集成&lt;br /&gt;
&lt;br /&gt;
* [[Data transformation]]  数据转换&lt;br /&gt;
&lt;br /&gt;
* [[Electronic discovery]]  电子发现&lt;br /&gt;
&lt;br /&gt;
* [[Information extraction]]  信息提取&lt;br /&gt;
&lt;br /&gt;
* [[Information integration]]  信息集成&lt;br /&gt;
&lt;br /&gt;
* [[Named-entity recognition]]  命名实体识别&lt;br /&gt;
&lt;br /&gt;
* [[Profiling (information science)]]  分析（信息科学）&lt;br /&gt;
&lt;br /&gt;
* [[Psychometrics]]  心理测量学&lt;br /&gt;
&lt;br /&gt;
* [[Social media mining]]  社交媒体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Surveillance capitalism]]  资本监视&lt;br /&gt;
&lt;br /&gt;
* [[Web scraping]]  网页抓取&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
;Other resources&lt;br /&gt;
&lt;br /&gt;
Other resources&lt;br /&gt;
&lt;br /&gt;
其他资源&lt;br /&gt;
&lt;br /&gt;
*[[International Journal of Data Warehousing and Mining]]  国际数据仓库与挖掘杂志&lt;br /&gt;
&lt;br /&gt;
==参考文献 References==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|30em}}&lt;br /&gt;
&lt;br /&gt;
==进一步阅读 Further reading==&lt;br /&gt;
&lt;br /&gt;
{{div col|colwidth=30em}}&lt;br /&gt;
&lt;br /&gt;
* Cabena, Peter; Hadjnian, Pablo; Stadler, Rolf; Verhees, Jaap; Zanasi, Alessandro (1997); ''Discovering Data Mining: From Concept to Implementation'', [[Prentice Hall]], {{ISBN|0-13-743980-6}}&lt;br /&gt;
&lt;br /&gt;
* M.S. Chen, J. Han, [[Philip S. Yu|P.S. Yu]] (1996) &amp;quot;[http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/chen_tkde96.pdf Data mining: an overview from a database perspective]&amp;quot;. ''Knowledge and data Engineering, IEEE Transactions'' on 8 (6), 866–883&lt;br /&gt;
&lt;br /&gt;
* Feldman, Ronen; Sanger, James (2007); ''The Text Mining Handbook'', [[Cambridge University Press]], {{ISBN|978-0-521-83657-9}}&lt;br /&gt;
&lt;br /&gt;
* Guo, Yike; and Grossman, Robert (editors) (1999); ''High Performance Data Mining: Scaling Algorithms, Applications and Systems'', [[Kluwer Academic Publishers]]&lt;br /&gt;
&lt;br /&gt;
* [[Jiawei Han|Han, Jiawei]], Micheline Kamber, and Jian Pei. ''Data mining: concepts and techniques''. Morgan kaufmann, 2006.&lt;br /&gt;
&lt;br /&gt;
* [[Trevor Hastie|Hastie, Trevor]], [[Robert Tibshirani|Tibshirani, Robert]] and [[Jerome H. Friedman|Friedman, Jerome]] (2001); ''The Elements of Statistical Learning: Data Mining, Inference, and Prediction'', Springer, {{ISBN|0-387-95284-5}}&lt;br /&gt;
&lt;br /&gt;
* [[Bing Liu (computer scientist)|Liu, Bing]] (2007, 2011); ''Web Data Mining: Exploring Hyperlinks, Contents and Usage Data'', [[Springer Verlag|Springer]], {{ISBN|3-540-37881-2}}&lt;br /&gt;
&lt;br /&gt;
* {{cite journal |last=Murphy |first=Chris |date=16 May 2011 |title=Is Data Mining Free Speech? |journal=[[InformationWeek]] |page=12 }}&lt;br /&gt;
&lt;br /&gt;
* Nisbet, Robert; Elder, John; Miner, Gary (2009); ''Handbook of Statistical Analysis &amp;amp; Data Mining Applications'', [[Academic Press]]/Elsevier, {{ISBN|978-0-12-374765-5}}&lt;br /&gt;
&lt;br /&gt;
* Poncelet, Pascal; Masseglia, Florent; and Teisseire, Maguelonne (editors) (October 2007); &amp;quot;Data Mining Patterns: New Methods and Applications&amp;quot;, ''Information Science Reference'', {{ISBN|978-1-59904-162-9}}&lt;br /&gt;
&lt;br /&gt;
* Tan, Pang-Ning; Steinbach, Michael; and Kumar, Vipin (2005); ''Introduction to Data Mining'', {{ISBN|0-321-32136-7}}&lt;br /&gt;
&lt;br /&gt;
* Theodoridis, Sergios; and Koutroumbas, Konstantinos (2009); ''Pattern Recognition'', 4th Edition, Academic Press, {{ISBN|978-1-59749-272-0}}&lt;br /&gt;
&lt;br /&gt;
* Weiss, Sholom M.; and Indurkhya, Nitin (1998); ''Predictive Data Mining'', [[Morgan Kaufmann]]&lt;br /&gt;
&lt;br /&gt;
* {{cite book |author1=Witten, Ian H.|authorlink1=Ian H. Witten |author2=Frank, Eibe |author3=Hall, Mark A. |title=Data Mining: Practical Machine Learning Tools and Techniques |edition=3 |date=30 January 2011 |publisher=Elsevier |isbn=978-0-12-374856-0 }} (See also [[Weka (machine learning)|Free Weka software]])&lt;br /&gt;
&lt;br /&gt;
* Ye, Nong (2003); ''The Handbook of Data Mining'', Mahwah, NJ: Lawrence Erlbaum&lt;br /&gt;
&lt;br /&gt;
{{div col end}}&lt;br /&gt;
&lt;br /&gt;
==相关链接External links==&lt;br /&gt;
&lt;br /&gt;
{{Commons category|Data mining}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Reference/Knowledge_Management/Knowledge_Discovery/Software|Knowledge Discovery Software}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Computers/Software/Databases/Data_Mining/Tool_Vendors|Data Mining Tool Vendors}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{data}}&lt;br /&gt;
&lt;br /&gt;
{{Data warehouse}}&lt;br /&gt;
&lt;br /&gt;
{{Computer science}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{Authority control}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{DEFAULTSORT:Data Mining}}&lt;br /&gt;
&lt;br /&gt;
[[Category:Data mining| ]]&lt;br /&gt;
&lt;br /&gt;
[[Category:Formal sciences]]&lt;br /&gt;
&lt;br /&gt;
Category:Formal sciences&lt;br /&gt;
&lt;br /&gt;
类别: 正规科学&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Data mining]]. Its edit history can be viewed at [[数据挖掘/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13896</id>
		<title>数据挖掘</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13896"/>
		<updated>2020-09-11T04:54:22Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条由许菁翻译整理。&lt;br /&gt;
&lt;br /&gt;
{{Machine learning bar}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Data mining''' is the process of discovering patterns in large [[data set]]s involving methods at the intersection of [[machine learning]], [[statistics]], and [[database system]]s.&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; Data mining is an [[interdisciplinary]] subfield of [[computer science]] and [[statistics]] with an overall goal to extract information (with intelligent methods) from a data set and transform the information into a comprehensible structure for further use.&amp;lt;ref name=&amp;quot;acm&amp;quot;&amp;gt;{{cite web |url=http://www.kdd.org/curriculum/index.html |title=Data Mining Curriculum |publisher=[[Association for Computing Machinery|ACM]] [[SIGKDD]] |date=2006-04-30 |accessdate=2014-01-27 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;brittanica&amp;quot;&amp;gt;{{cite web |last=Clifton |first=Christopher |title=Encyclopædia Britannica: Definition of Data Mining |year=2010 |url=http://www.britannica.com/EBchecked/topic/1056150/data-mining |accessdate=2010-12-09 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;elements&amp;quot;&amp;gt;{{cite web|last1=Hastie|first1=Trevor|authorlink1=Trevor Hastie|last2=Tibshirani|first2=Robert|authorlink2=Robert Tibshirani|last3=Friedman|first3=Jerome|authorlink3=Jerome H. Friedman|title=The Elements of Statistical Learning: Data Mining, Inference, and Prediction|year=2009|url=http://www-stat.stanford.edu/~tibs/ElemStatLearn/|accessdate=2012-08-07|archive-url=https://web.archive.org/web/20091110212529/http://www-stat.stanford.edu/~tibs/ElemStatLearn/|archive-date=2009-11-10|url-status=dead}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book|last1=Han, Kamber, Pei|first1=Jaiwei, Micheline, Jian|title=Data Mining: Concepts and Techniques|date=June 9, 2011|publisher=Morgan Kaufmann|isbn=978-0-12-381479-1|edition=3rd}}&amp;lt;/ref&amp;gt; Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt; Aside from the raw analysis step, it also involves database and [[data management]] aspects, [[data pre-processing]], [[statistical model|model]] and [[Statistical inference|inference]] considerations, interestingness metrics, [[Computational complexity theory|complexity]] considerations, post-processing of discovered structures, [[Data visualization|visualization]], and [[Online algorithm|online updating]].&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; &lt;br /&gt;
&lt;br /&gt;
Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD. Aside from the raw analysis step, it also involves database and data management aspects, data pre-processing, model and inference considerations, interestingness metrics, complexity considerations, post-processing of discovered structures, visualization, and online updating. &lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘 Data Mining &amp;lt;/font&amp;gt;'''是在大型数据集中发现模式的过程，是一种涉及到机器学习、统计学和数据库系统综合使用的方法。数据挖掘是指“在数据库中发现知识(knowledge discovery in databases,KDD)”过程中的分析步骤。除了传统的分析步骤，它还涉及数据库和数据管理方面，包括数据预处理、模型和推理考虑、兴趣度量、复杂性考虑、发现结构的后处理、可视化和在线更新等内容。&lt;br /&gt;
--[[用户:Zengsihang|Zengsihang]]（[[用户讨论:Zengsihang|讨论]]） 【审校】“数据挖掘是指“在数据库中知识发现KDD”的过程的分析步骤”一句中的“在数据库中知识发现KDD”处改为“在数据库中发现知识(knowledge discovery in databases,KDD)”&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a [[misnomer]], because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (''mining'') of data itself.&amp;lt;ref name=&amp;quot;han-kamber&amp;quot;&amp;gt;{{cite book|title=Data mining: concepts and techniques|last1=Han|first1=Jiawei|last2=Kamber|first2=Micheline|date=2001|publisher=[[Morgan Kaufmann]]|isbn=978-1-55860-489-6|page=5|quote=Thus, data mining should have been more appropriately named &amp;quot;knowledge mining from data,&amp;quot; which is unfortunately somewhat long|authorlink1=Jiawei Han}}&amp;lt;/ref&amp;gt; It also is a [[buzzword]]&amp;lt;ref&amp;gt;[http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf OKAIRP 2005 Fall Conference, Arizona State University] {{Webarchive|url=https://web.archive.org/web/20140201170452/http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf|date=2014-02-01}}&amp;lt;/ref&amp;gt; and is frequently applied to any form of large-scale data or [[information processing]] ([[Data collection|collection]], [[information extraction|extraction]], [[Data warehouse|warehousing]], analysis, and statistics) as well as any application of [[Decision support system|computer decision support system]], including [[artificial intelligence]] (e.g., machine learning) and [[business intelligence]]. The book ''Data mining: Practical machine learning tools and techniques with Java''&amp;lt;ref name=&amp;quot;witten&amp;quot;&amp;gt;{{cite book|title=Data Mining: Practical Machine Learning Tools and Techniques|last1=Witten|first1=Ian H.|last2=Frank|first2=Eibe|last3=Hall|first3=Mark A.|date=30 January 2011|publisher=Elsevier|isbn=978-0-12-374856-0|edition=3|authorlink1=Ian H. Witten}}&amp;lt;/ref&amp;gt; (which covers mostly machine learning material) was originally to be named just ''Practical machine learning'', and the term ''data mining'' was only added for marketing reasons.&amp;lt;ref&amp;gt;{{Cite journal|author1=Bouckaert, Remco R.|author2=Frank, Eibe|author3=Hall, Mark A.|author4=Holmes, Geoffrey|author5=Pfahringer, Bernhard|author6=Reutemann, Peter|author7=Witten, Ian H.|authorlink7=Ian H. Witten|year=2010|title=WEKA Experiences with a Java open-source project|journal=Journal of Machine Learning Research|volume=11|pages=2533–2541|quote=the original title, &amp;quot;Practical machine learning&amp;quot;, was changed&amp;amp;nbsp;... The term &amp;quot;data mining&amp;quot; was [added] primarily for marketing reasons.|postscript={{inconsistent citations}}}}&amp;lt;/ref&amp;gt; Often the more general terms (''large scale'') ''[[data analysis]]'' and ''[[analytics]]'' – or, when referring to actual methods, ''artificial intelligence'' and ''machine learning'' – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a misnomer, because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (mining) of data itself. It also is a buzzword and is frequently applied to any form of large-scale data or information processing (collection, extraction, warehousing, analysis, and statistics) as well as any application of computer decision support system, including artificial intelligence (e.g., machine learning) and business intelligence. The book Data mining: Practical machine learning tools and techniques with Java (which covers mostly machine learning material) was originally to be named just Practical machine learning, and the term data mining was only added for marketing reasons. Often the more general terms (large scale) data analysis and analytics – or, when referring to actual methods, artificial intelligence and machine learning – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
“数据挖掘”这种形容其实并不十分恰当，因为我们的目标是从大量数据中提取模式和知识，而不是数据本身的提取(挖掘)。它是一个流行语，经常用于任何形式的大规模数据或信息处理（收集、提取、仓储、分析和统计）的场景下，以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 计算机决策系统 Decision Support System，DSS&amp;lt;/font&amp;gt;'''的任何应用当中，包括人工智能（例如机器学习）和商业智能。《数据挖掘：使用Java的实用机器学习工具和技术》（主要涵盖机器学习材料）一书最初被命名为“实用机器学习”，而数据挖掘一词只是为了营销的原因而增加。经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records ([[cluster analysis]]), unusual records ([[anomaly detection]]), and dependencies ([[association rule mining]], [[sequential pattern mining]]). This usually involves using database techniques such as [[spatial index|spatial indices]]. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and [[predictive analytics]]. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a [[decision support system]]. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records (cluster analysis), unusual records (anomaly detection), and dependencies (association rule mining, sequential pattern mining). This usually involves using database techniques such as spatial indices. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and predictive analytics. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a decision support system. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
实际上数据挖掘任务是对大量数据进行半自动或全自动分析，以提取出从前未知的且有趣的模式，如数据记录组(数据聚类)、异常记录组(异常检测)和依赖关系(关联规则挖掘，序列挖掘)。这通常涉及使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种汇总，并且可以用于进一步的分析，或者，例如，机器学习和预测分析。例如，数据挖掘步骤可以识别数据中的多个组，然后可以使用该步骤通过决策支持系统获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是作为附加步骤属于整个 KDD 过程。&lt;br /&gt;
&lt;br /&gt;
如数据记录组（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''）、异常记录（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly Detection&amp;lt;/font&amp;gt;'''）和依赖关系（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则挖掘 Association Rule Mining&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;序列模式挖掘 Sequential Pattern Mining&amp;lt;/font&amp;gt;'''）。这通常涉及到使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种规律总结，可以用于进一步的分析，或者，例如，在机器学习和预测分析中。例如，通过数据挖掘可以出识别数据中的多个组，然后这些组可以通过使用决策支持系统来获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是属于整个KDD过程的附加步骤。&lt;br /&gt;
&lt;br /&gt;
The difference between [[data analysis]] and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&amp;lt;ref&amp;gt;Olson, D. L. (2007). Data mining in business services. ''Service Business'', ''1''(3), 181-193. {{doi|10.1007/s11628-006-0014-7}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The difference between data analysis and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据分析 Data Analysis&amp;lt;/font&amp;gt;'''和数据挖掘的区别在于，数据分析用于测试数据集上的模型和假设，例如，分析营销活动的有效性，而不考虑数据量的多少；相反，数据挖掘使用机器学习和统计模型来发现“大量”数据中的秘密或隐藏模式。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The related terms ''[[data dredging]]'', ''data fishing'', and ''data snooping'' refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
The related terms data dredging, data fishing, and data snooping refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
相关术语'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;“数据疏浚” Data Dredging&amp;lt;/font&amp;gt;'''、“数据钓鱼”和“数据窥探”是指使用数据挖掘方法对较大的人口数据集中的一部分进行抽样，这些数据集太小（或可能太小），无法对所发现的任何模式的有效性作出可靠的统计推断。但是，这些方法可以用于提出新的假设，以针对更大的数据群体进行测试。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==起源 Etymology==&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like ''data fishing'' or ''data dredging'' to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist [[Michael Lovell]] in an article published in the ''[[Review of Economic Studies]]'' in 1983.&amp;lt;ref&amp;gt;{{Cite journal|last=Lovell|first=Michael C.|date=1983|title=Data Mining|journal=The Review of Economics and Statistics|volume=65|issue=1|pages=1–12|doi=10.2307/1924403|jstor=1924403}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book |first=Wojciech W. |last=Charemza |first2=Derek F. |last2=Deadman |title=New Directions in Econometric Practice |location=Aldershot |publisher=Edward Elgar |year=1992 |chapter=Data Mining |pages=14–31 |isbn=1-85278-461-X }}&amp;lt;/ref&amp;gt; Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like data fishing or data dredging to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist Michael Lovell in an article published in the Review of Economic Studies in 1983. Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
在20世纪60年代，统计学家和经济学家们曾经使用“数据钓鱼”或”数据疏浚“等术语来指代他们认为在没有先验假设的情况下进行数据分析的糟糕做法。经济学家迈克尔•洛弗尔 Michael Lovell 在1983年《经济研究评论》（Review of Economic Studies）上发表的一篇文章中，也以类似的批判方式使用了“数据挖掘”这个术语。Lovell 指出，这种做法“伪装成各种别名，从“实验”(正面)到“钓鱼”或“窥探”(负面)。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term ''data mining'' appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation;&amp;lt;ref name=&amp;quot;Mena&amp;quot;&amp;gt;{{cite book |last=Mena |first=Jesús |year=2011 |title=Machine Learning Forensics for Law Enforcement, Security, and Intelligence |location=Boca Raton, FL |publisher=CRC Press (Taylor &amp;amp; Francis Group) |isbn=978-1-4398-6069-4 }}&amp;lt;/ref&amp;gt; researchers consequently turned to ''data mining''. Other terms used include ''data archaeology'', ''information harvesting'', ''information discovery'', ''knowledge extraction'', etc. [[Gregory I. Piatetsky-Shapiro|Gregory Piatetsky-Shapiro]] coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic [http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] and this term became more popular in [[Artificial intelligence|AI]] and [[machine learning]] community. However, the term data mining became more popular in the business and press communities.&amp;lt;ref&amp;gt;{{cite web |last1=Piatetsky-Shapiro |first1=Gregory |authorlink1=Gregory Piatetsky-Shapiro |last2=Parker |first2=Gary |url=http://www.kdnuggets.com/data_mining_course/x1-intro-to-data-mining-notes.html |title=Lesson: Data Mining, and Knowledge Discovery: An Introduction |publisher=KD Nuggets |year=2011 |work=Introduction to Data Mining |accessdate=30 August 2012 }}&amp;lt;/ref&amp;gt; Currently, the terms ''data mining'' and ''knowledge discovery'' are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
The term data mining appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation; researchers consequently turned to data mining. Other terms used include data archaeology, information harvesting, information discovery, knowledge extraction, etc. Gregory Piatetsky-Shapiro coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic (KDD-1989) and this term became more popular in AI and machine learning community. However, the term data mining became more popular in the business and press communities. Currently, the terms data mining and knowledge discovery are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
数据挖掘这个术语在1990年左右出现在数据库领域，通常有着积极的内涵。在20世纪80年代的一段短暂时间里，人们曾使用过“数据库挖掘”这种表达，但由于这个词被总部位于圣地亚哥的 HNC 公司注册为商标，因此研究人员转向了数据挖掘。曾用过的其他术语包括数据考古学、信息收集、信息发现、知识提取等。格雷戈里·皮亚特斯基·夏皮罗 Gregory Piatetsky-Shapiro 在关于这个主题的第一个研讨会[ http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] 上首次创造了“数据库中的知识发现 Knowledge Discovery in Databases，KDD”这个术语。此后，这个术语在人工智能和机器学习社区中变得更加流行。然而，数据挖掘这个术语在商业和出版界变得越来越流行。目前，数据挖掘和知识发现 knowledge discovery这两个术语可以互换使用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery ([[KDD-95]]) was started in Montreal under [[AAAI]] sponsorship. It was co-chaired by [[Usama Fayyad]] and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called [[Data Mining and Knowledge Discovery]] as its founding editor-in-chief. Later he started the [[SIGKDD]] Newsletter SIGKDD Explorations.&amp;lt;ref name=SIGKDD-explorations&amp;gt;{{cite journal|last1=Fayyad|first1=Usama|title=First Editorial by Editor-in-Chief|journal=SIGKDD Explorations|date=15 June 1999|volume=13|issue=1|pages=102|doi=10.1145/2207243.2207269|url=http://www.kdd.org/explorations/view/june-1999-volume-1-issue-1|accessdate=27 December 2010|ref=SIGKDD-explorations}}&amp;lt;/ref&amp;gt; The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal ''Data Mining and Knowledge Discovery'' is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery (KDD-95) was started in Montreal under AAAI sponsorship. It was co-chaired by Usama Fayyad and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called Data Mining and Knowledge Discovery as its founding editor-in-chief. Later he started the SIGKDD Newsletter SIGKDD Explorations.The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal Data Mining and Knowledge Discovery is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
在学术界，主要的研究论坛始于1995年，当时，在AAAI的赞助下，第一届数据挖掘和知识发现国际会议（KDD-95）在蒙特利尔召开。会议由乌萨马·法耶兹 Usama Fayyad和拉玛萨米·乌图鲁萨米 Ramasamy Uthurusamy共同主持。一年后，1996年Usama Fayyad创办了杂志《数据挖掘与知识发现》（datamining and Knowledge Discovery），担任创始主编。后来他创办了SIGKDD时事通讯探索。那个KDD国际会议也成为了数据挖掘领域质量最高的主要会议，其研究论文提交的接受率低于18%，而《数据挖掘与知识发现》也成为了该领域的主要研究期刊。&lt;br /&gt;
&lt;br /&gt;
==背景 Background==&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from [[data]] has occurred for centuries. Early methods of identifying patterns in data include [[Bayes' theorem]] (1700s) and [[regression analysis]] (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As [[data set]]s have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as [[neural networks]], [[cluster analysis]], [[genetic algorithms]] (1950s), [[decision tree learning|decision trees]] and [[decision rules]] (1960s), and [[support vector machines]] (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns&amp;lt;ref name=&amp;quot;Kantardzic&amp;quot;&amp;gt;{{cite book |last=Kantardzic |first=Mehmed |title=Data Mining: Concepts, Models, Methods, and Algorithms |year=2003 |publisher=John Wiley &amp;amp; Sons |isbn=978-0-471-22852-3 |oclc=50055336 |url-access=registration |url=https://archive.org/details/dataminingconcep0000kant }}&amp;lt;/ref&amp;gt; in large data sets. It bridges the gap from [[applied statistics]] and artificial intelligence (which usually provide the mathematical background) to [[database management]] by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from data has occurred for centuries. Early methods of identifying patterns in data include Bayes' theorem (1700s) and regression analysis (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As data sets have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as neural networks, cluster analysis, genetic algorithms (1950s), decision trees and decision rules (1960s), and support vector machines (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns in large data sets. It bridges the gap from applied statistics and artificial intelligence (which usually provide the mathematical background) to database management by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
从数据中手动提取模式的方法已经持续了好几个世纪了。早期识别数据模式的方法包括17世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;贝叶斯定理 Bayes' Theorem&amp;lt;/font&amp;gt;'''和19世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归分析 Regression Analysis&amp;lt;/font&amp;gt;'''。计算机技术的扩散、其普遍性和日益强大的能力极大地提高了数据的收集、存储和操作能力。随着数据集的规模和复杂性的增长，手动分析数据的方法越来越多地被更强的间接、自动化的数据处理所取代，这都得益于计算机科学其他领域取得的新的进步，特别是机器学习领域的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;神经网络 Neural Networks&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;遗传算法 Genetic Algorithms&amp;lt;/font&amp;gt;'''（1950年代），'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策树 Decision Tree&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策规则 Decision Rules&amp;lt;/font&amp;gt;'''（1960年代）以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;支持向量机 Support Vector Machines&amp;lt;/font&amp;gt;'''（1990年代）等。数据挖掘就是应用这些方法来发现大型数据集中的隐藏模式的过程。它利用数据在数据库中存储和索引的方式，更有效地执行实际的学习和发现算法，从而弥补了从应用统计学和人工智能(通常提供数学背景)到数据库管理之间的差距，使这些方法能够应用于更大的数据集。&lt;br /&gt;
&lt;br /&gt;
==发展过程 Process==&lt;br /&gt;
&lt;br /&gt;
The ''knowledge discovery in databases (KDD) process'' is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
The knowledge discovery in databases (KDD) process is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
数据库中的知识发现 Knowledge Discovery in Databases ，KDD过程通常定义为以下几个阶段:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Selection&lt;br /&gt;
&lt;br /&gt;
 Selection&lt;br /&gt;
&lt;br /&gt;
选择&lt;br /&gt;
&lt;br /&gt;
# Pre-processing&lt;br /&gt;
&lt;br /&gt;
 Pre-processing&lt;br /&gt;
&lt;br /&gt;
预处理&lt;br /&gt;
&lt;br /&gt;
# Transformation&lt;br /&gt;
&lt;br /&gt;
 Transformation&lt;br /&gt;
&lt;br /&gt;
转换&lt;br /&gt;
&lt;br /&gt;
# ''Data mining''&lt;br /&gt;
&lt;br /&gt;
 Data mining&lt;br /&gt;
&lt;br /&gt;
数据挖掘&lt;br /&gt;
&lt;br /&gt;
# Interpretation/evaluation.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
 Interpretation/evaluation.&lt;br /&gt;
&lt;br /&gt;
解释 / 评估。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the [[Cross-industry standard process for data mining]] (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the Cross-industry standard process for data mining (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
然而，它存在于这个主题的许多变体中，例如在'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘的跨行业标准流程 Cross-industry standard process for data mining，CRISP-DM&amp;lt;/font&amp;gt;'''中它定义了以下六个阶段：&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Business understanding&lt;br /&gt;
&lt;br /&gt;
 Business understanding&lt;br /&gt;
&lt;br /&gt;
商业理解&lt;br /&gt;
&lt;br /&gt;
# Data understanding&lt;br /&gt;
&lt;br /&gt;
 Data understanding&lt;br /&gt;
&lt;br /&gt;
数据理解&lt;br /&gt;
&lt;br /&gt;
# Data preparation&lt;br /&gt;
&lt;br /&gt;
 Data preparation&lt;br /&gt;
&lt;br /&gt;
数据准备&lt;br /&gt;
&lt;br /&gt;
# Modeling&lt;br /&gt;
&lt;br /&gt;
 Modeling&lt;br /&gt;
&lt;br /&gt;
建模&lt;br /&gt;
&lt;br /&gt;
# Evaluation&lt;br /&gt;
&lt;br /&gt;
 Evaluation&lt;br /&gt;
&lt;br /&gt;
评估&lt;br /&gt;
&lt;br /&gt;
# Deployment&lt;br /&gt;
&lt;br /&gt;
 Deployment&lt;br /&gt;
&lt;br /&gt;
部署&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
或一个简化的过程，包括：(1)预处理，(2)数据挖掘，(3)结果验证。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners.&amp;lt;ref&amp;gt;[[Gregory Piatetsky-Shapiro]] (2002) [http://www.kdnuggets.com/polls/2002/methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2004) [http://www.kdnuggets.com/polls/2004/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2007) [http://www.kdnuggets.com/polls/2007/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2014) [http://www.kdnuggets.com/polls/2014/analytics-data-mining-data-science-methodology.html ''KDnuggets Methodology Poll'']&amp;lt;/ref&amp;gt; The only other data mining standard named in these polls was [[SEMMA]]. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models,&amp;lt;ref name=&amp;quot;kurgan&amp;quot;&amp;gt;Lukasz Kurgan and Petr Musilek (2006); [http://journals.cambridge.org/action/displayAbstract?fromPage=online&amp;amp;aid=451120 ''A survey of Knowledge Discovery and Data Mining process models'']. The Knowledge Engineering Review. Volume 21 Issue 1, March 2006, pp&amp;amp;nbsp;1–24, Cambridge University Press, New York, NY, USA {{DOI|10.1017/S0269888906000737}}&amp;lt;/ref&amp;gt; and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&amp;lt;ref name=&amp;quot;AzevedoSantos&amp;quot;&amp;gt;Azevedo, A. and Santos, M. F. [http://www.iadis.net/dl/final_uploads/200812P033.pdf KDD, SEMMA and CRISP-DM: a parallel overview] {{webarchive|url=https://web.archive.org/web/20130109114939/http://www.iadis.net/dl/final_uploads/200812P033.pdf |date=2013-01-09 }}. In Proceedings of the IADIS European Conference on Data Mining 2008, pp&amp;amp;nbsp;182–185.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners. The only other data mining standard named in these polls was SEMMA. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models, and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&lt;br /&gt;
&lt;br /&gt;
在这些调查中，唯一的其他数据挖掘标准是SEMMA。然而，使用CRISP-DM的人数是其3-4倍。一些研究小组已经发表了关于数据挖掘过程模型的研究，例如阿泽维多 Azevedo和 桑托斯Santos曾在2008年对CRISP-DM和SEMMA这两套数据挖掘流程标准进行了比较。&lt;br /&gt;
&lt;br /&gt;
===预处理 Pre-processing===&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a [[data mart]] or [[data warehouse]]. Pre-processing is essential to analyze the [[Multivariate statistics|multivariate]] data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing [[statistical noise|noise]] and those with [[missing data]].&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a data mart or data warehouse. Pre-processing is essential to analyze the multivariate data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing noise and those with missing data.&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须先对目标数据集进行整合。由于数据挖掘只能发现数据中实际存在的模式，目标数据集必须足够大以包含这些模式，同时保持足够简洁以便在可接受的时间限制内进行挖掘。数据的公共源是数据集市或数据仓库。在数据挖掘之前，对多变量数据集进行预处理是必不可少的。然后清理目标集。数据清理去除了包含噪声的观测值和缺失数据的观测值。&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须组装目标数据集。由于数据挖掘只能发现数据中实际存在的模式，因此目标数据集必须足够大以包含这些模式，同时保持足够简洁，以便在可接受的时间限制内进行挖掘。数据的常见来源是'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据集市 Data Mart&amp;lt;/font&amp;gt;'''或'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据仓库 Data Warehouse&amp;lt;/font&amp;gt;'''。在数据挖掘之前，对'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;多元 Multivariate&amp;lt;/font&amp;gt;'''数据集进行预处理是必不可少的，然后对目标集进行清洗。数据清洗将删除包含'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;噪声 Noise&amp;lt;/font&amp;gt;'''的观测值和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;缺失数据 Missing Data&amp;lt;/font&amp;gt;'''的观测值。&lt;br /&gt;
&lt;br /&gt;
===数据挖掘 Data mining===&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&amp;lt;ref name=&amp;quot;Fayyad&amp;quot;&amp;gt;{{cite web |last1=Fayyad |first1=Usama |authorlink1=Usama Fayyad |last2=Piatetsky-Shapiro |first2=Gregory|authorlink2=Gregory Piatetsky-Shapiro |last3=Smyth |first3=Padhraic |title=From Data Mining to Knowledge Discovery in Databases |year=1996 |url=http://www.kdnuggets.com/gpspubs/aimag-kdd-overview-1996-Fayyad.pdf |accessdate = 17 December 2008 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&lt;br /&gt;
&lt;br /&gt;
数据挖掘涉及六类常见的任务:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection]] (outlier/change/deviation detection) – The identification of unusual data records, that might be interesting or data errors that require further investigation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly detection&amp;lt;/font&amp;gt;'''（异常值/变化/偏差检测）：识别异常数据记录，发现可能是有趣的或需要进一步调查的数据错误。&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]] (dependency modeling) – Searches for relationships between variables. For example, a supermarket might gather data on customer purchasing habits. Using association rule learning, the supermarket can determine which products are frequently bought together and use this information for marketing purposes. This is sometimes referred to as market basket analysis.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则学习 Association rule learning&amp;lt;/font&amp;gt;'''（依赖关系建模）：探变量之间的关系。例如，超市可能会收集顾客购买习惯的数据。通过使用关联规则学习，超市可以确定哪些产品经常被一起购买，并将这些信息用于营销策略改进。这种研究有时被称为“市场篮子分析”。&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis|Clustering]] – is the task of discovering groups and structures in the data that are in some way or another &amp;quot;similar&amp;quot;, without using known structures in the data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类 Clustering&amp;lt;/font&amp;gt;'''：是指在数据中发现以某种方式或其他方式“相似”的组和结构，而不使用数据中已知的结构。&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]] – is the task of generalizing known structure to apply to new data. For example, an e-mail program might attempt to classify an e-mail as &amp;quot;legitimate&amp;quot; or as &amp;quot;spam&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;分类 Classification&amp;lt;/font&amp;gt;'''：是将已知结构归纳为新数据的任务。例如，电子邮件程序可能会尝试将电子邮件分类为“合法”或“垃圾邮件”。&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis|Regression]] – attempts to find a function that models the data with the least error that is, for estimating the relationships among data or datasets.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归&amp;lt;/font&amp;gt;'''：试图找到一个对数据建模误差最小的函数，也就是说，用于估计数据或数据集之间的关系。&lt;br /&gt;
&lt;br /&gt;
* [[Automatic summarization|Summarization]] – providing a more compact representation of the data set, including visualization and report generation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;自动文摘 Automatic summarizatio&amp;lt;/font&amp;gt;'''：提供数据集更紧凑、简洁的表示，包括可视化和报告生成。&lt;br /&gt;
&lt;br /&gt;
===结果验证 Results validation===&lt;br /&gt;
&lt;br /&gt;
[[File:Spurious correlations - spelling bee spiders.svg|thumb|An example of data produced by [[data dredging]] through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence. 一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。]]&lt;br /&gt;
&lt;br /&gt;
An example of data produced by data dredging through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence.&lt;br /&gt;
&lt;br /&gt;
一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be [[Reproducibility|reproduced]] on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper [[statistical hypothesis testing]]. A simple version of this problem in [[machine learning]] is known as [[overfitting]], but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&amp;lt;ref name=hawkins&amp;gt;{{cite journal | last1 = Hawkins | first1 = Douglas M | year = 2004 | title = The problem of overfitting | url = | journal = Journal of Chemical Information and Computer Sciences | volume = 44 | issue = 1| pages = 1–12 | doi=10.1021/ci0342472| pmid = 14741005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be reproduced on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper statistical hypothesis testing. A simple version of this problem in machine learning is known as overfitting, but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&lt;br /&gt;
&lt;br /&gt;
数据挖掘可能会在无意中被误用，然后产生看似重要的结果; 但这些结果实际上并不能用来预测未来的行为，也不能在新的数据样本上进行复现，而且用处不大。这通常是由于调查了太多的假设，而没有进行适当的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;统计假设检验 Statistical Hypothesis Testing&amp;lt;/font&amp;gt;'''。在机器学习中，这种问题可以被简称为'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''，但相同的问题可能会在过程的不同阶段出现，因此，在完全适用的情况下，合理进行训练/测试分割这一种方法可能不足以防止这种情况的发生。&lt;br /&gt;
&lt;br /&gt;
{{Missing information|section|non-classification tasks in data mining. It only covers [[machine learning]]|date=September 2011}}&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called [[overfitting]]. To overcome this, the evaluation uses a [[test set]] of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a [[training set]] of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had ''not'' been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as [[Receiver operating characteristic|ROC curves]].&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called overfitting. To overcome this, the evaluation uses a test set of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a training set of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had not been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as ROC curves.&lt;br /&gt;
&lt;br /&gt;
从数据中发现知识的最后一步是验证数据挖掘算法产生的模式是否存在于更广泛的数据集中。数据挖掘算法发现的并非所有模式都是有效的，因为对于数据挖掘算法来说，在训练集中发现一般数据集中没有的模式是很常见的，这叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''。为了克服这个问题，评估使用一组测试数据，而数据挖掘算法并没有在这些测试数据上进行训练。然后将学习到的模式应用到这个'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;测试集 Test Set&amp;lt;/font&amp;gt;'''中，并将结果输出与期望的输出进行比较。例如，试图区分“垃圾邮件”和“合法”邮件的数据挖掘算法将根据一组电子邮件'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;训练集 Training Sett&amp;lt;/font&amp;gt;'''样本进行训练。训练完毕后，学到的模式将应用于未经训练的那部分电子邮件测试集数据上。然后，可以从这些模式正确分类的电子邮件数量来衡量这些模式的准确性。可以使用几种统计方法可以用来评估算法，如'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;ROC 曲线 ROC curves&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
如果学习的模式不能达到预期的标准，那么就需要重新评估和修改预处理和数据挖掘的步骤。如果所学的模式确实符合所需的标准，那么最后一步就是对习得的模式进行解释并将其转化为知识。&lt;br /&gt;
&lt;br /&gt;
==研究 Research==&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the [[Association for Computing Machinery]]'s (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining ([[SIGKDD]]).&amp;lt;ref&amp;gt;{{cite web|url=http://academic.research.microsoft.com/?SearchDomain=2&amp;amp;SubDomain=7&amp;amp;entitytype=2|title=Microsoft Academic Search: Top conferences in data mining | publisher=[[Microsoft Academic Search]]}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|url=https://scholar.google.de/citations?view_op=top_venues&amp;amp;hl=en&amp;amp;vq=eng_datamininganalysis|title=Google Scholar: Top publications - Data Mining &amp;amp; Analysis|publisher=[[Google Scholar]]}}&amp;lt;/ref&amp;gt; Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings,&amp;lt;ref&amp;gt;[http://www.kdd.org/conferences.php Proceedings] {{Webarchive|url=https://web.archive.org/web/20100430120252/http://www.kdd.org/conferences.php |date=2010-04-30 }}, International Conferences on Knowledge Discovery and Data Mining, ACM, New York.&amp;lt;/ref&amp;gt; and since 1999 it has published a biannual [[academic journal]] titled &amp;quot;SIGKDD Explorations&amp;quot;.&amp;lt;ref&amp;gt;[http://www.kdd.org/explorations/about.php SIGKDD Explorations], ACM, New York.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the Association for Computing Machinery's (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining (SIGKDD). Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings, and since 1999 it has published a biannual academic journal titled &amp;quot;SIGKDD Explorations&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
该领域的首要专业机构是计算机协会 ACM的知识发现和数据挖掘特别兴趣小组 SIGKDD。自1989年以来，ACM SIG每年举办一次国际会议并出版会议记录，自1999年起，它还出版了一份名为“SIGKDD探索”的两年期学术期刊。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
关于数据挖掘的计算机科学会议包括:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[CIKM Conference]] – ACM [[Conference on Information and Knowledge Management]]&lt;br /&gt;
&lt;br /&gt;
CIKM会议 ：ACM'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;信息和知识管理会议 Conference on Information and Knowledge Management&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
* [[European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases]]&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;欧洲机器学习与数据库知识发现原理与实践会议 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
* [[KDD Conference]] – ACM SIGKDD [[Conference on Knowledge Discovery and Data Mining]]&lt;br /&gt;
&lt;br /&gt;
KDD会议：ACM SIGKDD的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;知识发现与数据挖掘会议 Conference on Knowledge Discovery and Data Mining&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many [[List of computer science conferences#Data Management|data management/database conferences]] such as the ICDE Conference, [[SIGMOD|SIGMOD Conference]] and [[International Conference on Very Large Data Bases]]&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many data management/database conferences such as the ICDE Conference, SIGMOD Conference and International Conference on Very Large Data Bases.&lt;br /&gt;
&lt;br /&gt;
数据挖掘专题也出现在许多数据管理/数据库会议上，如 ICDE会议、 '''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;SIGMOD会议 SIGMOD Conference&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关于超大数据库国际会议International Conference on Very Large Data Bases&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
==标准 Standards==&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European [[Cross Industry Standard Process for Data Mining]] (CRISP-DM 1.0) and the 2004 [[Java Data Mining]] standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European Cross Industry Standard Process for Data Mining (CRISP-DM 1.0) and the 2004 Java Data Mining standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
为数据挖掘过程定义了一些标准，例如1999年欧洲跨行业数据挖掘标准流程（CRISP-DM 1.0）和2004年Java数据挖掘标准（JDM 1.0）。这些程序的后续程序（CRISP-DM 2.0和 JDM 2.0）的开发活跃于2006年，但此后一直停滞不前。Jdm 2.0没有达成最终草案就被撤销了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in [[predictive analytics]]&amp;amp;nbsp;– the key standard is the [[Predictive Model Markup Language]] (PMML), which is an [[XML]]-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) [[subspace clustering]] have been proposed independently of the DMG.&amp;lt;ref&amp;gt;{{Cite book | last1 = Günnemann | first1 = Stephan | last2 = Kremer | first2 = Hardy | last3 = Seidl | first3 = Thomas | doi = 10.1145/2023598.2023605 | chapter = An extension of the PMML standard to subspace clustering models | title = Proceedings of the 2011 workshop on Predictive markup language modeling - PMML '11 | pages = 48 | year = 2011 | isbn = 978-1-4503-0837-3 | pmid =  | pmc = }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in predictive analytics&amp;amp;nbsp;– the key standard is the Predictive Model Markup Language (PMML), which is an XML-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) subspace clustering have been proposed independently of the DMG.&lt;br /&gt;
&lt;br /&gt;
为了交换所提取的模型，特别是在预测分析中使用，关键的标准是预测模型标记语言 PMML，这是一种基于 XML 的语言，由数据挖掘集团 DMG 开发，并支持作为交换格式的许多数据挖掘应用程序。顾名思义，它只涵盖预测模型，这是一项对业务应用程序非常重要的特殊数据挖掘任务。然而，覆盖子空间聚类的扩展已经独立于 DMG 被提出。&lt;br /&gt;
&lt;br /&gt;
==显著用途 Notable uses==&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable [[examples of data mining]] can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable examples of data mining can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
数据挖掘在任何有数字数据可用的地方都可以被使用。数据挖掘的著名例子可以在商业、医学、科学和监控领域找到。&lt;br /&gt;
&lt;br /&gt;
==隐私问题和道德规范 Privacy concerns and ethics==&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&amp;lt;ref&amp;gt;{{cite journal |author=Seltzer, William |title=The Promise and Pitfalls of Data Mining: Ethical Issues |url=https://ww2.amstat.org/committees/ethics/linksdir/Jsm2005Seltzer.pdf|publisher = American Statistical Association|journal = ASA Section on Government Statistics|date = 2005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&lt;br /&gt;
&lt;br /&gt;
虽然“数据挖掘”这个术语本身可能没有伦理含义，但它通常与人们行为（伦理和其他）相关的信息挖掘有关。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding [[privacy]], legality, and ethics.&amp;lt;ref&amp;gt;{{cite journal |author=Pitts, Chip |title=The End of Illegal Domestic Spying? Don't Count on It |url=http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |journal=Washington Spectator |date=15 March 2007 |url-status=dead |archiveurl=https://web.archive.org/web/20071128015201/http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |archivedate=2007-11-28 }}&amp;lt;/ref&amp;gt; In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the [[Total Information Awareness]] Program or in [[ADVISE]], has raised privacy concerns.&amp;lt;ref&amp;gt;{{cite journal |author=Taipale, Kim A. |title=Data Mining and Domestic Security: Connecting the Dots to Make Sense of Data |url=http://www.stlr.org/cite.cgi?volume=5&amp;amp;article=2 |journal=Columbia Science and Technology Law Review |volume=5 |issue=2 |date=15 December 2003 |ssrn=546782 |oclc=45263753 }}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|last1=Resig|first1=John|title=A Framework for Mining Instant Messaging Services|url=https://johnresig.com/files/research/SIAMPaper.pdf|accessdate=16 March 2018}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding privacy, legality, and ethics. In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the Total Information Awareness Program or in ADVISE, has raised privacy concerns.&lt;br /&gt;
&lt;br /&gt;
在某些情况下，数据挖掘的使用方式可能会引发隐私、合法性和伦理问题。特别是，为国家安全或执法目的而进行的政府或商业数据集的数据挖掘，如在全面信息意识项目或在 ADVISE 中，引起了隐私问题。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through [[aggregate function|data aggregation]]. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent).&amp;lt;ref name=&amp;quot;NASCIO&amp;quot;&amp;gt;[http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf ''Think Before You Dig: Privacy Implications of Data Mining &amp;amp; Aggregation''] {{webarchive|url=https://web.archive.org/web/20081217063043/http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf |date=2008-12-17 }}, NASCIO Research Brief, September 2004&amp;lt;/ref&amp;gt; This is not data mining ''per se'', but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&amp;lt;ref&amp;gt;{{cite magazine |first=Paul |last=Ohm |title=Don't Build a Database of Ruin |magazine=Harvard Business Review |url=http://blogs.hbr.org/cs/2012/08/dont_build_a_database_of_ruin.html}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/12/03/iron-cagebook/ Iron Cagebook - The Logical End of Facebook's Patents], [[Counterpunch.org]], 2013.12.03&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/09/11/inside-the-tech-industrys-startup-conference/ Inside the Tech industry's Startup Conference], [[Counterpunch.org]], 2013.09.11&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through data aggregation. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent). This is not data mining per se, but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&lt;br /&gt;
&lt;br /&gt;
数据挖掘需要进行数据准备，以发现损害机密性和隐私义务的信息或模式。实现这一点的一种常见方式是通过'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据聚合 Data Aggregation&amp;lt;/font&amp;gt;'''。数据聚合包括以一种便于分析的方式将数据（可能来自不同的来源）组合在一起（但这也可能使私人、个人级别的数据的识别变得可推断或以其他方式显而易见）。但这并不是数据挖掘本身，而是在分析之前以及为分析目的准备数据的结果。当数据被编译后，数据挖掘者或任何有权访问新编译的数据集的人能够识别特定的个人，特别是当数据最初是匿名的时，对个人隐私的威胁就开始发挥作用了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It is recommended{{whom|date=August 2019}} to be aware of the following '''before''' data are collected:&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
It is recommended to be aware of the following before data are collected:&lt;br /&gt;
&lt;br /&gt;
在收集数据之前，建议注意以下事项:&lt;br /&gt;
&lt;br /&gt;
* The purpose of the data collection and any (known) data mining projects;&lt;br /&gt;
&lt;br /&gt;
数据收集和任何（已知的）数据挖掘项目的目的；&lt;br /&gt;
&lt;br /&gt;
* How the data will be used;&lt;br /&gt;
&lt;br /&gt;
数据使用的方法；&lt;br /&gt;
&lt;br /&gt;
* Who will be able to mine the data and use the data and their derivatives;&lt;br /&gt;
&lt;br /&gt;
谁将能够挖掘数据并使用这些数据及其衍生工具；&lt;br /&gt;
&lt;br /&gt;
* The status of security surrounding access to the data;&lt;br /&gt;
&lt;br /&gt;
数据访问的安全状态；&lt;br /&gt;
&lt;br /&gt;
* How collected data can be updated.&lt;br /&gt;
&lt;br /&gt;
如何更新收集的数据。&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to ''become'' anonymous, so that individuals may not readily be identified.&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt; However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&amp;lt;ref&amp;gt;[http://www.securityfocus.com/brief/277 ''AOL search data identified individuals''], SecurityFocus, August 2006&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to become anonymous, so that individuals may not readily be identified.However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&lt;br /&gt;
&lt;br /&gt;
数据也可以被修改成匿名的，这样个人就不容易被修改了确定。但是，甚至“匿名化”的数据集也可能包含足够的信息用来识别个人，就像记者能够根据一组无意中搜索历史找到几个个人一样美国在线发布。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of [[personally identifiable information]] leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of [[privacy violation]], the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&amp;lt;ref&amp;gt;{{Cite journal|title = Big data׳s impact on privacy, security and consumer welfare|journal = Telecommunications Policy|pages = 1134–1145|volume = 38|issue = 11|doi = 10.1016/j.telpol.2014.10.002|first = Nir|last = Kshetri|year = 2014|url = http://libres.uncg.edu/ir/uncg/f/N_Kshetri_Big_2014.pdf}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of personally identifiable information leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of privacy violation, the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
无意中泄露个人身份信息导致提供者违反了公平信息惯例。这种轻率的行为会对指定的个人造成经济、情感或身体伤害。在一起侵犯隐私的案例中，沃尔格林 Walgreens的赞助人在2011年对该公司提起诉讼，指控该公司向数据挖掘公司出售处方信息，而数据挖掘公司又将这些数据提供给制药公司。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲的情况 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[European Union|Europe]] has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the [[International Safe Harbor Privacy Principles|U.S.-E.U. Safe Harbor Principles]], developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of [[Edward Snowden]]'s [[global surveillance disclosure]], there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the [[National Security Agency]], and attempts to reach an agreement with the United States have failed.&amp;lt;ref&amp;gt;{{cite web |url=https://crsreports.congress.gov/product/pdf/R/R44257/7 |title=U.S.-E.U. Data Privacy: From Safe Harbor to Privacy Shield |last1=Weiss |first1=Martin A. |last2=Archick |first2=Kristin |date=19 May 2016 |department= |website= |series= |agency=Congressional Research Service |location=Washington, D.C. |page=6 |pages= |format=PDF |id=R44257 |access-date=9 April 2020 |quote=On October 6, 2015, the [[Court of Justice of the European Union|CJEU]]&amp;amp;nbsp;... issued a decision that invalidated Safe Harbor (effective immediately), as currently implemented. }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Europe has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the U.S.-E.U. Safe Harbor Principles, developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of Edward Snowden's global surveillance disclosure, there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the National Security Agency, and attempts to reach an agreement with the United States have failed.&lt;br /&gt;
&lt;br /&gt;
欧洲有相当强的隐私法，正在努力进一步加强消费者的权利。然而，1998年至2000年期间制定的《美国-欧盟安全港原则》（U.S.-E.U.Safe Harbor Principles）目前有效地使欧洲用户受到美国公司的隐私剥削。由于爱德华·斯诺登 Edward Snowden披露了全球监控信息后，关于撤销这一协议的讨论越来越多，尤其是数据将完全暴露给国家安全局，与美国达成协议的尝试也失败了。&lt;br /&gt;
&lt;br /&gt;
===美国的情况 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the [[US Congress]] via the passage of regulatory controls such as the [[Health Insurance Portability and Accountability Act]] (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in ''Biotech Business Week'', &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot;&amp;lt;ref&amp;gt;Biotech Business Week Editors (June 30, 2008); ''BIOMEDICINE; HIPAA Privacy Rule Impedes Biomedical Research'', Biotech Business Week, retrieved 17 November 2009 from LexisNexis Academic&amp;lt;/ref&amp;gt; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the US Congress via the passage of regulatory controls such as the Health Insurance Portability and Accountability Act (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in Biotech Business Week, &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
在美国，美国国会通过了《健康保险便携性和责任法案》（HIPAA）等监管措施，解决了隐私问题。HIPAA要求个人就其提供的信息及其当前和未来的预期用途给予“知情同意”。根据《生物技术商业周刊》的一篇文章，“在实践中，HIPAA可能不会比研究领域长期存在的法规提供更大的保护。”。更重要的是，该规则通过知情同意进行保护的目标是接近普通个人的不可理解程度。”这突出了数据聚合和挖掘实践中数据匿名的必要性。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the [[Family Educational Rights and Privacy Act]] (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the Family Educational Rights and Privacy Act (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
美国信息隐私立法，如 HIPAA 和《家庭教育权利和隐私法》（FERPA）仅适用于每一个此类法律所涉及的特定领域。美国大多数企业对数据挖掘的使用并不受任何法律的控制。&lt;br /&gt;
&lt;br /&gt;
== 数据挖掘与著作权法 Copyright law==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Under [[Copyright law of the European Union|European copyright]] and [[Database Directive|database law]]s, the mining of in-copyright works (such as by [[web mining]]) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright{{snd}} but database rights may exist so data mining becomes subject to [[intellectual property]] owners' rights that are protected by the [[Database Directive]]. On the recommendation of the [[Hargreaves review]], this led to the UK government to amend its copyright law in 2014 to allow content mining as a [[Limitations and exceptions to copyright|limitation and exception]].&amp;lt;ref&amp;gt;[http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ UK Researchers Given Data Mining Right Under New UK Copyright Laws.] {{webarchive |url=https://web.archive.org/web/20140609020315/http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ |date=June 9, 2014 }} ''Out-Law.com.''   Retrieved 14 November 2014&amp;lt;/ref&amp;gt; The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the [[Information Society Directive]] (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
Under European copyright and database laws, the mining of in-copyright works (such as by web mining) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright but database rights may exist so data mining becomes subject to intellectual property owners' rights that are protected by the Database Directive. On the recommendation of the Hargreaves review, this led to the UK government to amend its copyright law in 2014 to allow content mining as a limitation and exception. The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the Information Society Directive (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
根据欧洲版权法和数据库法，未经版权所有人许可而对版权作品进行挖掘（如通过网络挖掘）是不合法的。在欧洲，如果数据库是纯数据，可能没有版权，但数据库权利可能存在，因此数据挖掘受数据库指令保护的知识产权所有者的权利约束。根据《哈格里夫斯评论》（Hargreaves review）的建议，这导致英国政府在2014年修订了版权法，允许将内容挖掘作为一种限制和例外。英国是继日本之后世界上第二个这样做的国家，日本在2009年引入了数据挖掘的例外。然而，由于信息社会指令（2001年）的限制，英国是例外情况但是只允许非商业目的的内容挖掘。英国版权法也不允许合同条款和条件推翻这一规定。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The [[European Commission]] facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe.&amp;lt;ref&amp;gt;{{cite web|title=Licences for Europe - Structured Stakeholder Dialogue 2013|url=http://ec.europa.eu/licences-for-europe-dialogue/en/content/about-site|website=European Commission|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt; The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and [[open access]] publishers to leave the stakeholder dialogue in May 2013.&amp;lt;ref&amp;gt;{{cite web|title=Text and Data Mining:Its importance and the need for change in Europe|url=http://libereurope.eu/news/text-and-data-mining-its-importance-and-the-need-for-change-in-europe/|website=Association of European Research Libraries|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The European Commission facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe. The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and open access publishers to leave the stakeholder dialogue in May 2013.&lt;br /&gt;
&lt;br /&gt;
2013年，欧盟委员会以“欧洲许可证”为题，推动了利益相关者对文本和数据挖掘的讨论。但他们将重点放在解决这一法律问题上，如许可证而不是限制和例外，导致大学、研究人员、图书馆、民间社会团体和开放获取出版商的代表于2013年5月离开了利益相关者对话。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===美国 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Copyright law of the United States|US copyright law]], and in particular its provision for [[fair use]], upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the [[Google Book Search Settlement Agreement|Google Book settlement]] the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&amp;lt;ref&amp;gt;{{cite web|title=Judge grants summary judgment in favor of Google Books — a fair use victory|url=http://www.lexology.com/library/detail.aspx?g=a18c5b92-5a20-4d1d-a098-a3095046a88e|website=Lexology.com|publisher=Antonelli Law Ltd|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
US copyright law, and in particular its provision for fair use, upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the Google Book settlement the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&lt;br /&gt;
&lt;br /&gt;
美国版权法，特别是其中关于合理使用的条款，支持在美国和其他合理使用国家，如以色列，台湾和韩国采矿内容的合法性。由于内容挖掘是变革性的，也就是说，它不会取代原来的工作，它被视为合法的合理使用。例如，作为谷歌图书和解协议的一部分，此案的主审法官裁定，谷歌版权图书数字化项目是合法的，部分原因在于数字化项目所展示的变革性用途——其中之一就是文本和数据挖掘。&lt;br /&gt;
&lt;br /&gt;
==软件 Software==&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Data mining and machine learning software}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===开源的数据挖掘软件 Free open-source data mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以使用免费 / 开源许可证。应用程序源代码也是对公众开放访问的。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Carrot2]]: Text and search results clustering framework.  文本和搜索结果聚类框架。&lt;br /&gt;
&lt;br /&gt;
* [[Chemicalize.org]]: A chemical structure miner and web search engine.  化学结构挖掘与网络搜索引擎。&lt;br /&gt;
&lt;br /&gt;
* [[ELKI]]: A university research project with advanced [[cluster analysis]] and [[anomaly detection|outlier detection]] methods written in the [[Java (programming language)|Java]] language.  一个大学研究项目，用Java语言编写高级聚类分析和离群点检测方法。&lt;br /&gt;
&lt;br /&gt;
* [[General Architecture for Text Engineering|GATE]]: a [[natural language processing]] and language engineering tool.  一个自然语言处理和语言工程工具。&lt;br /&gt;
&lt;br /&gt;
* [[KNIME]]: The Konstanz Information Miner, a user-friendly and comprehensive data analytics framework.  Konstanz Information Miner，一个用户友好的综合数据分析框架。&lt;br /&gt;
&lt;br /&gt;
* [[MOA (Massive Online Analysis)|Massive Online Analysis (MOA)]]: a real-time big data stream mining with concept drift tool in the [[Java (programming language)|Java]] programming language.  利用Java语言中的概念漂移工具进行实时大数据流挖掘。&lt;br /&gt;
&lt;br /&gt;
* [[Multi expression programming|MEPX]] - cross-platform tool for regression and classification problems based on a Genetic Programming variant.  基于遗传编程变量的回归和分类问题的跨平台工具。&lt;br /&gt;
&lt;br /&gt;
* ML-Flex: A software package that enables users to integrate with third-party machine-learning packages written in any programming language, execute classification analyses in parallel across multiple computing nodes, and produce HTML reports of classification results.  一种软件包，使用户能够与用任何编程语言编写的第三方机器学习包集成，跨多个计算节点并行执行分类分析，并生成分类结果的HTML报告。&lt;br /&gt;
&lt;br /&gt;
* [[mlpack]]: a collection of ready-to-use machine learning algorithms written in the [[C++]] language. 一个用C++语言编写的机器学习算法的集合。&lt;br /&gt;
&lt;br /&gt;
* [[NLTK]] ([[Natural Language Toolkit]]): A suite of libraries and programs for symbolic and statistical natural language processing (NLP) for the [[Python (programming language)|Python]] language.  一套用于Python语言的符号和统计自然语言处理（NLP）的库和程序。&lt;br /&gt;
&lt;br /&gt;
* [[OpenNN]]: Open [[neural networks]] library.  开源的神经网络库。&lt;br /&gt;
&lt;br /&gt;
* [[Orange (software)|Orange]]: A component-based data mining and [[machine learning]] software suite written in the [[Python (programming language)|Python]] language. 一个用Python语言编写的基于组件的数据挖掘和机器学习软件套件。&lt;br /&gt;
&lt;br /&gt;
* [[R (programming language)|R]]: A [[programming language]] and software environment for [[statistics|statistical]] computing, data mining, and graphics. It is part of the [[GNU Project]]. 一种用于统计计算、数据挖掘和图形的编程语言和软件环境。它是GNU项目的一部分。&lt;br /&gt;
&lt;br /&gt;
* [[scikit-learn]] is an open-source machine learning library for the Python programming language  是Python编程语言的一个开源机器学习库&lt;br /&gt;
&lt;br /&gt;
* [[Torch (machine learning)|Torch]]: An [[open source model|open-source]] [[deep learning]] library for the [[Lua (programming language)|Lua]] programming language and [[scientific computing]] framework with wide support for [[machine learning]] algorithms.  一个开源的深度学习lib库语言和科学计算框架，广泛支持机器学习算法。&lt;br /&gt;
&lt;br /&gt;
* [[UIMA]]: The UIMA (Unstructured Information Management Architecture) is a component framework for analyzing unstructured content such as text, audio and video – originally developed by IBM.  UIMA（非结构化信息管理体系结构）是一个用于分析非结构化内容（如文本、音频和视频）的组件框架，最初由IBM开发。&lt;br /&gt;
&lt;br /&gt;
* [[Weka (machine learning)|Weka]]: A suite of machine learning software applications written in the [[Java (programming language)|Java]] programming language.  用Java编程语言编写的一套机器学习软件应用程序。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===需要专有许可的数据挖掘软件和应用程序 Proprietary data-mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以根据专有许可证提供。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Angoss]] KnowledgeSTUDIO: data mining tool  数据挖掘工具。&lt;br /&gt;
&lt;br /&gt;
* [[LIONsolver]]: an integrated software application for data mining, business intelligence, and modeling that implements the Learning and Intelligent OptimizatioN (LION) approach.  用于数据挖掘、商业智能和建模的集成软件应用程序，实现学习和智能优化（LION）方法。&lt;br /&gt;
&lt;br /&gt;
* Megaputer Intelligence: data and text mining software is called PolyAnalyst.  数据和文本挖掘软件PolyAnalyst。&lt;br /&gt;
&lt;br /&gt;
* [[Microsoft Analysis Services]]: data mining software provided by [[Microsoft]].  微软提供的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[NetOwl]]: suite of multilingual text and entity analytics products that enable data mining.  支持数据挖掘的多语言文本和实体分析产品套件。&lt;br /&gt;
&lt;br /&gt;
* [[Oracle Data Mining]]: data mining software by [[Oracle Corporation]].  Oracle公司的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[PSeven]]: platform for automation of engineering simulation and analysis, multidisciplinary optimization and data mining provided by [[DATADVANCE]].  DATADVANCE为工程仿真分析、多学科优化和数据挖掘提供自动化平台。&lt;br /&gt;
&lt;br /&gt;
* [[Qlucore]] Omics Explorer: data mining software.  数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[RapidMiner]]: An environment for [[machine learning]] and data mining experiments. &amp;lt;!-- Latest version is NOT opensource --&amp;gt;  一个用于机器学习和数据挖掘实验的环境。&lt;br /&gt;
&lt;br /&gt;
* [[SAS (software)#Components|SAS Enterprise Miner]]: data mining software provided by the [[SAS Institute]].  SAS机构提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[SPSS Modeler]]: data mining software provided by [[IBM]].  IBM提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[STATISTICA]] Data Miner: data mining software provided by [[StatSoft]].  StatSoft提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[Tanagra (machine learning)|Tanagra]]: Visualisation-oriented data mining software, also for teaching.  面向可视化的数据挖掘软件，也用于教学。&lt;br /&gt;
&lt;br /&gt;
* [[Vertica]]: data mining software provided by [[Hewlett-Packard]].  惠普提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
==扩展链接 See also==&lt;br /&gt;
&lt;br /&gt;
; Methods&lt;br /&gt;
&lt;br /&gt;
方法&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Agent mining]]  主体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection|Anomaly/outlier/change detection]]  异常/异常/变化检测&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]]  关联规则学习&lt;br /&gt;
&lt;br /&gt;
* [[Bayesian network]]s  贝叶斯网络&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]]  分类&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis]]  聚类分析&lt;br /&gt;
&lt;br /&gt;
* [[Decision tree]]s  决策树&lt;br /&gt;
&lt;br /&gt;
* [[Ensemble learning]]  集成学习&lt;br /&gt;
&lt;br /&gt;
* [[Factor analysis]]  因子分析&lt;br /&gt;
&lt;br /&gt;
* [[Genetic algorithms]]  遗传算法&lt;br /&gt;
&lt;br /&gt;
* [[Intention mining]]  意向玩具&lt;br /&gt;
&lt;br /&gt;
* [[Learning classifier system]]  学习分类器系统&lt;br /&gt;
&lt;br /&gt;
* [[Multilinear subspace learning]]  多线性子空间学习&lt;br /&gt;
&lt;br /&gt;
* [[Artificial neural network|Neural network]]s  神经网络&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis]]  回归分析&lt;br /&gt;
&lt;br /&gt;
* [[Sequence mining]]   序列挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Structured data analysis (statistics)|Structured data analysis]]  结构数据学习&lt;br /&gt;
&lt;br /&gt;
* [[Support vector machines]]  支持向量机&lt;br /&gt;
&lt;br /&gt;
* [[Text mining]]  文本挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Time series|Time series analysis]]  时间序列分析&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application domains&lt;br /&gt;
&lt;br /&gt;
应用领域&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Analytics]] 分析&lt;br /&gt;
&lt;br /&gt;
* [[Behavior informatics]]  行为信息学&lt;br /&gt;
&lt;br /&gt;
* [[Big Data|Big data]]  大数据&lt;br /&gt;
&lt;br /&gt;
* [[Bioinformatics]]  生物信息学&lt;br /&gt;
&lt;br /&gt;
* [[Business intelligence]]  商务智能&lt;br /&gt;
&lt;br /&gt;
* [[Data analysis]]  数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Data warehouse]]  数据仓库&lt;br /&gt;
&lt;br /&gt;
* [[Decision support system]]  决策支持系统&lt;br /&gt;
&lt;br /&gt;
* [[Domain driven data mining]]  域驱动的数据挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Drug discovery]]  药物发现&lt;br /&gt;
&lt;br /&gt;
* [[Exploratory data analysis]]  探索性数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Predictive analytics]]  预测分析&lt;br /&gt;
&lt;br /&gt;
* [[Web mining]]  网页挖掘&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application examples&lt;br /&gt;
&lt;br /&gt;
应用示例&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|=&lt;br /&gt;
&lt;br /&gt;
*[[Automatic number plate recognition in the United Kingdom#Data mining|Automatic number plate recognition in the United Kingdom]]  英国的自动车牌识别&lt;br /&gt;
&lt;br /&gt;
*[[Customer analytics#Data mining|Customer analytics]]  客户分析&lt;br /&gt;
&lt;br /&gt;
*[[Educational data mining]]  教育数据挖掘&lt;br /&gt;
&lt;br /&gt;
*[[National Security Agency#Transaction data mining|National Security Agency]]  国家安全局&lt;br /&gt;
&lt;br /&gt;
*[[Quantitative structure–activity relationship#Data mining approach|Quantitative structure–activity relationship]]  数量结构-活动关系&lt;br /&gt;
&lt;br /&gt;
*[[Surveillance#Data mining and profiling|Surveillance]] / [[Mass surveillance#Data mining|Mass surveillance]] (e.g., [[Stellar Wind (code name)|Stellar Wind]])&lt;br /&gt;
监控/大规模监测（例如，恒星风）&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Related topics&lt;br /&gt;
&lt;br /&gt;
相关话题&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to ''analyzing'' data) , see:&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to analyzing data) , see:&lt;br /&gt;
&lt;br /&gt;
有关从数据中提取信息(与分析数据相反)的详细信息，请参阅:&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Data integration]]  数据集成&lt;br /&gt;
&lt;br /&gt;
* [[Data transformation]]  数据转换&lt;br /&gt;
&lt;br /&gt;
* [[Electronic discovery]]  电子发现&lt;br /&gt;
&lt;br /&gt;
* [[Information extraction]]  信息提取&lt;br /&gt;
&lt;br /&gt;
* [[Information integration]]  信息集成&lt;br /&gt;
&lt;br /&gt;
* [[Named-entity recognition]]  命名实体识别&lt;br /&gt;
&lt;br /&gt;
* [[Profiling (information science)]]  分析（信息科学）&lt;br /&gt;
&lt;br /&gt;
* [[Psychometrics]]  心理测量学&lt;br /&gt;
&lt;br /&gt;
* [[Social media mining]]  社交媒体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Surveillance capitalism]]  资本监视&lt;br /&gt;
&lt;br /&gt;
* [[Web scraping]]  网页抓取&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
;Other resources&lt;br /&gt;
&lt;br /&gt;
Other resources&lt;br /&gt;
&lt;br /&gt;
其他资源&lt;br /&gt;
&lt;br /&gt;
*[[International Journal of Data Warehousing and Mining]]  国际数据仓库与挖掘杂志&lt;br /&gt;
&lt;br /&gt;
==参考文献 References==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|30em}}&lt;br /&gt;
&lt;br /&gt;
==进一步阅读 Further reading==&lt;br /&gt;
&lt;br /&gt;
{{div col|colwidth=30em}}&lt;br /&gt;
&lt;br /&gt;
* Cabena, Peter; Hadjnian, Pablo; Stadler, Rolf; Verhees, Jaap; Zanasi, Alessandro (1997); ''Discovering Data Mining: From Concept to Implementation'', [[Prentice Hall]], {{ISBN|0-13-743980-6}}&lt;br /&gt;
&lt;br /&gt;
* M.S. Chen, J. Han, [[Philip S. Yu|P.S. Yu]] (1996) &amp;quot;[http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/chen_tkde96.pdf Data mining: an overview from a database perspective]&amp;quot;. ''Knowledge and data Engineering, IEEE Transactions'' on 8 (6), 866–883&lt;br /&gt;
&lt;br /&gt;
* Feldman, Ronen; Sanger, James (2007); ''The Text Mining Handbook'', [[Cambridge University Press]], {{ISBN|978-0-521-83657-9}}&lt;br /&gt;
&lt;br /&gt;
* Guo, Yike; and Grossman, Robert (editors) (1999); ''High Performance Data Mining: Scaling Algorithms, Applications and Systems'', [[Kluwer Academic Publishers]]&lt;br /&gt;
&lt;br /&gt;
* [[Jiawei Han|Han, Jiawei]], Micheline Kamber, and Jian Pei. ''Data mining: concepts and techniques''. Morgan kaufmann, 2006.&lt;br /&gt;
&lt;br /&gt;
* [[Trevor Hastie|Hastie, Trevor]], [[Robert Tibshirani|Tibshirani, Robert]] and [[Jerome H. Friedman|Friedman, Jerome]] (2001); ''The Elements of Statistical Learning: Data Mining, Inference, and Prediction'', Springer, {{ISBN|0-387-95284-5}}&lt;br /&gt;
&lt;br /&gt;
* [[Bing Liu (computer scientist)|Liu, Bing]] (2007, 2011); ''Web Data Mining: Exploring Hyperlinks, Contents and Usage Data'', [[Springer Verlag|Springer]], {{ISBN|3-540-37881-2}}&lt;br /&gt;
&lt;br /&gt;
* {{cite journal |last=Murphy |first=Chris |date=16 May 2011 |title=Is Data Mining Free Speech? |journal=[[InformationWeek]] |page=12 }}&lt;br /&gt;
&lt;br /&gt;
* Nisbet, Robert; Elder, John; Miner, Gary (2009); ''Handbook of Statistical Analysis &amp;amp; Data Mining Applications'', [[Academic Press]]/Elsevier, {{ISBN|978-0-12-374765-5}}&lt;br /&gt;
&lt;br /&gt;
* Poncelet, Pascal; Masseglia, Florent; and Teisseire, Maguelonne (editors) (October 2007); &amp;quot;Data Mining Patterns: New Methods and Applications&amp;quot;, ''Information Science Reference'', {{ISBN|978-1-59904-162-9}}&lt;br /&gt;
&lt;br /&gt;
* Tan, Pang-Ning; Steinbach, Michael; and Kumar, Vipin (2005); ''Introduction to Data Mining'', {{ISBN|0-321-32136-7}}&lt;br /&gt;
&lt;br /&gt;
* Theodoridis, Sergios; and Koutroumbas, Konstantinos (2009); ''Pattern Recognition'', 4th Edition, Academic Press, {{ISBN|978-1-59749-272-0}}&lt;br /&gt;
&lt;br /&gt;
* Weiss, Sholom M.; and Indurkhya, Nitin (1998); ''Predictive Data Mining'', [[Morgan Kaufmann]]&lt;br /&gt;
&lt;br /&gt;
* {{cite book |author1=Witten, Ian H.|authorlink1=Ian H. Witten |author2=Frank, Eibe |author3=Hall, Mark A. |title=Data Mining: Practical Machine Learning Tools and Techniques |edition=3 |date=30 January 2011 |publisher=Elsevier |isbn=978-0-12-374856-0 }} (See also [[Weka (machine learning)|Free Weka software]])&lt;br /&gt;
&lt;br /&gt;
* Ye, Nong (2003); ''The Handbook of Data Mining'', Mahwah, NJ: Lawrence Erlbaum&lt;br /&gt;
&lt;br /&gt;
{{div col end}}&lt;br /&gt;
&lt;br /&gt;
==相关链接External links==&lt;br /&gt;
&lt;br /&gt;
{{Commons category|Data mining}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Reference/Knowledge_Management/Knowledge_Discovery/Software|Knowledge Discovery Software}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Computers/Software/Databases/Data_Mining/Tool_Vendors|Data Mining Tool Vendors}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{data}}&lt;br /&gt;
&lt;br /&gt;
{{Data warehouse}}&lt;br /&gt;
&lt;br /&gt;
{{Computer science}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{Authority control}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{DEFAULTSORT:Data Mining}}&lt;br /&gt;
&lt;br /&gt;
[[Category:Data mining| ]]&lt;br /&gt;
&lt;br /&gt;
[[Category:Formal sciences]]&lt;br /&gt;
&lt;br /&gt;
Category:Formal sciences&lt;br /&gt;
&lt;br /&gt;
类别: 正规科学&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Data mining]]. Its edit history can be viewed at [[数据挖掘/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
	<entry>
		<id>https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13867</id>
		<title>数据挖掘</title>
		<link rel="alternate" type="text/html" href="https://wiki.swarma.org/index.php?title=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&amp;diff=13867"/>
		<updated>2020-09-09T15:03:45Z</updated>

		<summary type="html">&lt;p&gt;Zengsihang：&lt;/p&gt;
&lt;hr /&gt;
&lt;div&gt;此词条由许菁翻译整理。&lt;br /&gt;
&lt;br /&gt;
{{Machine learning bar}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
'''Data mining''' is the process of discovering patterns in large [[data set]]s involving methods at the intersection of [[machine learning]], [[statistics]], and [[database system]]s.&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; Data mining is an [[interdisciplinary]] subfield of [[computer science]] and [[statistics]] with an overall goal to extract information (with intelligent methods) from a data set and transform the information into a comprehensible structure for further use.&amp;lt;ref name=&amp;quot;acm&amp;quot;&amp;gt;{{cite web |url=http://www.kdd.org/curriculum/index.html |title=Data Mining Curriculum |publisher=[[Association for Computing Machinery|ACM]] [[SIGKDD]] |date=2006-04-30 |accessdate=2014-01-27 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;brittanica&amp;quot;&amp;gt;{{cite web |last=Clifton |first=Christopher |title=Encyclopædia Britannica: Definition of Data Mining |year=2010 |url=http://www.britannica.com/EBchecked/topic/1056150/data-mining |accessdate=2010-12-09 }}&amp;lt;/ref&amp;gt;&amp;lt;ref name=&amp;quot;elements&amp;quot;&amp;gt;{{cite web|last1=Hastie|first1=Trevor|authorlink1=Trevor Hastie|last2=Tibshirani|first2=Robert|authorlink2=Robert Tibshirani|last3=Friedman|first3=Jerome|authorlink3=Jerome H. Friedman|title=The Elements of Statistical Learning: Data Mining, Inference, and Prediction|year=2009|url=http://www-stat.stanford.edu/~tibs/ElemStatLearn/|accessdate=2012-08-07|archive-url=https://web.archive.org/web/20091110212529/http://www-stat.stanford.edu/~tibs/ElemStatLearn/|archive-date=2009-11-10|url-status=dead}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book|last1=Han, Kamber, Pei|first1=Jaiwei, Micheline, Jian|title=Data Mining: Concepts and Techniques|date=June 9, 2011|publisher=Morgan Kaufmann|isbn=978-0-12-381479-1|edition=3rd}}&amp;lt;/ref&amp;gt; Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt; Aside from the raw analysis step, it also involves database and [[data management]] aspects, [[data pre-processing]], [[statistical model|model]] and [[Statistical inference|inference]] considerations, interestingness metrics, [[Computational complexity theory|complexity]] considerations, post-processing of discovered structures, [[Data visualization|visualization]], and [[Online algorithm|online updating]].&amp;lt;ref name=&amp;quot;acm&amp;quot; /&amp;gt; &lt;br /&gt;
&lt;br /&gt;
Data mining is the process of discovering patterns in large data sets involving methods at the intersection of machine learning, statistics, and database systems. Data mining is the analysis step of the &amp;quot;knowledge discovery in databases&amp;quot; process or KDD. Aside from the raw analysis step, it also involves database and data management aspects, data pre-processing, model and inference considerations, interestingness metrics, complexity considerations, post-processing of discovered structures, visualization, and online updating. &lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘 Data Mining &amp;lt;/font&amp;gt;'''是在大型数据集中发现模式的过程，是一种涉及到机器学习、统计学和数据库系统综合使用的方法。数据挖掘是指“在数据库中发现知识(knowledge discovery in databases,KDD)”的过程的分析步骤。除了传统的分析步骤，它还涉及数据库和数据管理方面，包括数据预处理、模型和推理考虑、兴趣度量、复杂性考虑、发现结构的后处理、可视化和在线更新等内容。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a [[misnomer]], because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (''mining'') of data itself.&amp;lt;ref name=&amp;quot;han-kamber&amp;quot;&amp;gt;{{cite book|title=Data mining: concepts and techniques|last1=Han|first1=Jiawei|last2=Kamber|first2=Micheline|date=2001|publisher=[[Morgan Kaufmann]]|isbn=978-1-55860-489-6|page=5|quote=Thus, data mining should have been more appropriately named &amp;quot;knowledge mining from data,&amp;quot; which is unfortunately somewhat long|authorlink1=Jiawei Han}}&amp;lt;/ref&amp;gt; It also is a [[buzzword]]&amp;lt;ref&amp;gt;[http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf OKAIRP 2005 Fall Conference, Arizona State University] {{Webarchive|url=https://web.archive.org/web/20140201170452/http://www.okairp.org/documents/2005%20Fall/F05_ROMEDataQualityETC.pdf|date=2014-02-01}}&amp;lt;/ref&amp;gt; and is frequently applied to any form of large-scale data or [[information processing]] ([[Data collection|collection]], [[information extraction|extraction]], [[Data warehouse|warehousing]], analysis, and statistics) as well as any application of [[Decision support system|computer decision support system]], including [[artificial intelligence]] (e.g., machine learning) and [[business intelligence]]. The book ''Data mining: Practical machine learning tools and techniques with Java''&amp;lt;ref name=&amp;quot;witten&amp;quot;&amp;gt;{{cite book|title=Data Mining: Practical Machine Learning Tools and Techniques|last1=Witten|first1=Ian H.|last2=Frank|first2=Eibe|last3=Hall|first3=Mark A.|date=30 January 2011|publisher=Elsevier|isbn=978-0-12-374856-0|edition=3|authorlink1=Ian H. Witten}}&amp;lt;/ref&amp;gt; (which covers mostly machine learning material) was originally to be named just ''Practical machine learning'', and the term ''data mining'' was only added for marketing reasons.&amp;lt;ref&amp;gt;{{Cite journal|author1=Bouckaert, Remco R.|author2=Frank, Eibe|author3=Hall, Mark A.|author4=Holmes, Geoffrey|author5=Pfahringer, Bernhard|author6=Reutemann, Peter|author7=Witten, Ian H.|authorlink7=Ian H. Witten|year=2010|title=WEKA Experiences with a Java open-source project|journal=Journal of Machine Learning Research|volume=11|pages=2533–2541|quote=the original title, &amp;quot;Practical machine learning&amp;quot;, was changed&amp;amp;nbsp;... The term &amp;quot;data mining&amp;quot; was [added] primarily for marketing reasons.|postscript={{inconsistent citations}}}}&amp;lt;/ref&amp;gt; Often the more general terms (''large scale'') ''[[data analysis]]'' and ''[[analytics]]'' – or, when referring to actual methods, ''artificial intelligence'' and ''machine learning'' – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
The term &amp;quot;data mining&amp;quot; is a misnomer, because the goal is the extraction of patterns and knowledge from large amounts of data, not the extraction (mining) of data itself. It also is a buzzword and is frequently applied to any form of large-scale data or information processing (collection, extraction, warehousing, analysis, and statistics) as well as any application of computer decision support system, including artificial intelligence (e.g., machine learning) and business intelligence. The book Data mining: Practical machine learning tools and techniques with Java (which covers mostly machine learning material) was originally to be named just Practical machine learning, and the term data mining was only added for marketing reasons. Often the more general terms (large scale) data analysis and analytics – or, when referring to actual methods, artificial intelligence and machine learning – are more appropriate.&lt;br /&gt;
&lt;br /&gt;
“数据挖掘”这种形容其实并不十分恰当，因为我们的目标是从大量数据中提取模式和知识，而不是数据本身的提取(挖掘)。它是一个流行语，经常用于任何形式的大规模数据或信息处理（收集、提取、仓储、分析和统计）的场景下，以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt; 计算机决策系统 Decision Support System，DSS&amp;lt;/font&amp;gt;'''的任何应用当中，包括人工智能（例如机器学习）和商业智能。《数据挖掘：使用Java的实用机器学习工具和技术》（主要涵盖机器学习材料）一书最初被命名为“实用机器学习”，而数据挖掘一词只是为了营销的原因而增加。经常更一般的术语例如（大规模）数据分析和分析——或当提到实际的方法时使用人工智能和机器学习这样的词语更加合适。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records ([[cluster analysis]]), unusual records ([[anomaly detection]]), and dependencies ([[association rule mining]], [[sequential pattern mining]]). This usually involves using database techniques such as [[spatial index|spatial indices]]. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and [[predictive analytics]]. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a [[decision support system]]. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
The actual data mining task is the semi-automatic or automatic analysis of large quantities of data to extract previously unknown, interesting patterns such as groups of data records (cluster analysis), unusual records (anomaly detection), and dependencies (association rule mining, sequential pattern mining). This usually involves using database techniques such as spatial indices. These patterns can then be seen as a kind of summary of the input data, and may be used in further analysis or, for example, in machine learning and predictive analytics. For example, the data mining step might identify multiple groups in the data, which can then be used to obtain more accurate prediction results by a decision support system. Neither the data collection, data preparation, nor result interpretation and reporting is part of the data mining step, but do belong to the overall KDD process as additional steps.&lt;br /&gt;
&lt;br /&gt;
实际上数据挖掘任务是对大量数据进行半自动或全自动分析，以提取出从前未知的且有趣的模式，如数据记录组(数据聚类)、异常记录组(异常检测)和依赖关系(关联规则挖掘，序列挖掘)。这通常涉及使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种汇总，并且可以用于进一步的分析，或者，例如，机器学习和预测分析。例如，数据挖掘步骤可以识别数据中的多个组，然后可以使用该步骤通过决策支持系统获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是作为附加步骤属于整个 KDD 过程。&lt;br /&gt;
&lt;br /&gt;
如数据记录组（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''）、异常记录（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly Detection&amp;lt;/font&amp;gt;'''）和依赖关系（'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则挖掘 Association Rule Mining&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;序列模式挖掘 Sequential Pattern Mining&amp;lt;/font&amp;gt;'''）。这通常涉及到使用数据库技术，如空间索引。这些模式可以被看作是输入数据的一种规律总结，可以用于进一步的分析，或者，例如，在机器学习和预测分析中。例如，通过数据挖掘可以出识别数据中的多个组，然后这些组可以通过使用决策支持系统来获得更准确的预测结果。数据收集、数据准备、结果解释和报告都不是数据挖掘步骤的一部分，而是属于整个KDD过程的附加步骤。&lt;br /&gt;
&lt;br /&gt;
The difference between [[data analysis]] and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&amp;lt;ref&amp;gt;Olson, D. L. (2007). Data mining in business services. ''Service Business'', ''1''(3), 181-193. {{doi|10.1007/s11628-006-0014-7}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The difference between data analysis and data mining is that data analysis is used to test models and hypotheses on the dataset, e.g., analyzing the effectiveness of a marketing campaign, regardless of the amount of data; in contrast, data mining uses machine learning and statistical models to uncover clandestine or hidden patterns in a large volume of data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据分析 Data Analysis&amp;lt;/font&amp;gt;'''和数据挖掘的区别在于，数据分析用于测试数据集上的模型和假设，例如，分析营销活动的有效性，而不考虑数据量的多少；相反，数据挖掘使用机器学习和统计模型来发现“大量”数据中的秘密或隐藏模式。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The related terms ''[[data dredging]]'', ''data fishing'', and ''data snooping'' refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
The related terms data dredging, data fishing, and data snooping refer to the use of data mining methods to sample parts of a larger population data set that are (or may be) too small for reliable statistical inferences to be made about the validity of any patterns discovered. These methods can, however, be used in creating new hypotheses to test against the larger data populations.&lt;br /&gt;
&lt;br /&gt;
相关术语'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;“数据疏浚” Data Dredging&amp;lt;/font&amp;gt;'''、“数据钓鱼”和“数据窥探”是指使用数据挖掘方法对较大的人口数据集中的一部分进行抽样，这些数据集太小（或可能太小），无法对所发现的任何模式的有效性作出可靠的统计推断。但是，这些方法可以用于提出新的假设，以针对更大的数据群体进行测试。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
==起源 Etymology==&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like ''data fishing'' or ''data dredging'' to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist [[Michael Lovell]] in an article published in the ''[[Review of Economic Studies]]'' in 1983.&amp;lt;ref&amp;gt;{{Cite journal|last=Lovell|first=Michael C.|date=1983|title=Data Mining|journal=The Review of Economics and Statistics|volume=65|issue=1|pages=1–12|doi=10.2307/1924403|jstor=1924403}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite book |first=Wojciech W. |last=Charemza |first2=Derek F. |last2=Deadman |title=New Directions in Econometric Practice |location=Aldershot |publisher=Edward Elgar |year=1992 |chapter=Data Mining |pages=14–31 |isbn=1-85278-461-X }}&amp;lt;/ref&amp;gt; Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
In the 1960s, statisticians and economists used terms like data fishing or data dredging to refer to what they considered the bad practice of analyzing data without an a-priori hypothesis. The term &amp;quot;data mining&amp;quot; was used in a similarly critical way by economist Michael Lovell in an article published in the Review of Economic Studies in 1983. Lovell indicates that the practice &amp;quot;masquerades under a variety of aliases, ranging from &amp;quot;experimentation&amp;quot; (positive) to &amp;quot;fishing&amp;quot; or &amp;quot;snooping&amp;quot; (negative).&lt;br /&gt;
&lt;br /&gt;
在20世纪60年代，统计学家和经济学家们曾经使用“数据钓鱼”或”数据疏浚“等术语来指代他们认为在没有先验假设的情况下进行数据分析的糟糕做法。经济学家迈克尔•洛弗尔 Michael Lovell 在1983年《经济研究评论》（Review of Economic Studies）上发表的一篇文章中，也以类似的批判方式使用了“数据挖掘”这个术语。Lovell 指出，这种做法“伪装成各种别名，从“实验”(正面)到“钓鱼”或“窥探”(负面)。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The term ''data mining'' appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation;&amp;lt;ref name=&amp;quot;Mena&amp;quot;&amp;gt;{{cite book |last=Mena |first=Jesús |year=2011 |title=Machine Learning Forensics for Law Enforcement, Security, and Intelligence |location=Boca Raton, FL |publisher=CRC Press (Taylor &amp;amp; Francis Group) |isbn=978-1-4398-6069-4 }}&amp;lt;/ref&amp;gt; researchers consequently turned to ''data mining''. Other terms used include ''data archaeology'', ''information harvesting'', ''information discovery'', ''knowledge extraction'', etc. [[Gregory I. Piatetsky-Shapiro|Gregory Piatetsky-Shapiro]] coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic [http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] and this term became more popular in [[Artificial intelligence|AI]] and [[machine learning]] community. However, the term data mining became more popular in the business and press communities.&amp;lt;ref&amp;gt;{{cite web |last1=Piatetsky-Shapiro |first1=Gregory |authorlink1=Gregory Piatetsky-Shapiro |last2=Parker |first2=Gary |url=http://www.kdnuggets.com/data_mining_course/x1-intro-to-data-mining-notes.html |title=Lesson: Data Mining, and Knowledge Discovery: An Introduction |publisher=KD Nuggets |year=2011 |work=Introduction to Data Mining |accessdate=30 August 2012 }}&amp;lt;/ref&amp;gt; Currently, the terms ''data mining'' and ''knowledge discovery'' are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
The term data mining appeared around 1990 in the database community, generally with positive connotations. For a short time in 1980s, a phrase &amp;quot;database mining&amp;quot;™, was used, but since it was trademarked by HNC, a San Diego-based company, to pitch their Database Mining Workstation; researchers consequently turned to data mining. Other terms used include data archaeology, information harvesting, information discovery, knowledge extraction, etc. Gregory Piatetsky-Shapiro coined the term &amp;quot;knowledge discovery in databases&amp;quot; for the first workshop on the same topic (KDD-1989) and this term became more popular in AI and machine learning community. However, the term data mining became more popular in the business and press communities. Currently, the terms data mining and knowledge discovery are used interchangeably.&lt;br /&gt;
&lt;br /&gt;
数据挖掘这个术语在1990年左右出现在数据库领域，通常有着积极的内涵。在20世纪80年代的一段短暂时间里，人们曾使用过“数据库挖掘”这种表达，但由于这个词被总部位于圣地亚哥的 HNC 公司注册为商标，因此研究人员转向了数据挖掘。曾用过的其他术语包括数据考古学、信息收集、信息发现、知识提取等。格雷戈里·皮亚特斯基·夏皮罗 Gregory Piatetsky-Shapiro 在关于这个主题的第一个研讨会[ http://www.kdnuggets.com/meetings/kdd89/ (KDD-1989)] 上首次创造了“数据库中的知识发现 Knowledge Discovery in Databases，KDD”这个术语。此后，这个术语在人工智能和机器学习社区中变得更加流行。然而，数据挖掘这个术语在商业和出版界变得越来越流行。目前，数据挖掘和知识发现 knowledge discovery这两个术语可以互换使用。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery ([[KDD-95]]) was started in Montreal under [[AAAI]] sponsorship. It was co-chaired by [[Usama Fayyad]] and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called [[Data Mining and Knowledge Discovery]] as its founding editor-in-chief. Later he started the [[SIGKDD]] Newsletter SIGKDD Explorations.&amp;lt;ref name=SIGKDD-explorations&amp;gt;{{cite journal|last1=Fayyad|first1=Usama|title=First Editorial by Editor-in-Chief|journal=SIGKDD Explorations|date=15 June 1999|volume=13|issue=1|pages=102|doi=10.1145/2207243.2207269|url=http://www.kdd.org/explorations/view/june-1999-volume-1-issue-1|accessdate=27 December 2010|ref=SIGKDD-explorations}}&amp;lt;/ref&amp;gt; The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal ''Data Mining and Knowledge Discovery'' is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the academic community, the major forums for research started in 1995 when the First International Conference on Data Mining and Knowledge Discovery (KDD-95) was started in Montreal under AAAI sponsorship. It was co-chaired by Usama Fayyad and Ramasamy Uthurusamy. A year later, in 1996, Usama Fayyad launched the journal by Kluwer called Data Mining and Knowledge Discovery as its founding editor-in-chief. Later he started the SIGKDD Newsletter SIGKDD Explorations.The KDD International conference became the primary highest quality conference in data mining with an acceptance rate of research paper submissions below 18%. The journal Data Mining and Knowledge Discovery is the primary research journal of the field.&lt;br /&gt;
&lt;br /&gt;
在学术界，主要的研究论坛始于1995年，当时，在AAAI的赞助下，第一届数据挖掘和知识发现国际会议（KDD-95）在蒙特利尔召开。会议由乌萨马·法耶兹 Usama Fayyad和拉玛萨米·乌图鲁萨米 Ramasamy Uthurusamy共同主持。一年后，1996年Usama Fayyad创办了杂志《数据挖掘与知识发现》（datamining and Knowledge Discovery），担任创始主编。后来他创办了SIGKDD时事通讯探索。那个KDD国际会议也成为了数据挖掘领域质量最高的主要会议，其研究论文提交的接受率低于18%，而《数据挖掘与知识发现》也成为了该领域的主要研究期刊。&lt;br /&gt;
&lt;br /&gt;
==背景 Background==&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from [[data]] has occurred for centuries. Early methods of identifying patterns in data include [[Bayes' theorem]] (1700s) and [[regression analysis]] (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As [[data set]]s have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as [[neural networks]], [[cluster analysis]], [[genetic algorithms]] (1950s), [[decision tree learning|decision trees]] and [[decision rules]] (1960s), and [[support vector machines]] (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns&amp;lt;ref name=&amp;quot;Kantardzic&amp;quot;&amp;gt;{{cite book |last=Kantardzic |first=Mehmed |title=Data Mining: Concepts, Models, Methods, and Algorithms |year=2003 |publisher=John Wiley &amp;amp; Sons |isbn=978-0-471-22852-3 |oclc=50055336 |url-access=registration |url=https://archive.org/details/dataminingconcep0000kant }}&amp;lt;/ref&amp;gt; in large data sets. It bridges the gap from [[applied statistics]] and artificial intelligence (which usually provide the mathematical background) to [[database management]] by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
The manual extraction of patterns from data has occurred for centuries. Early methods of identifying patterns in data include Bayes' theorem (1700s) and regression analysis (1800s). The proliferation, ubiquity and increasing power of computer technology have dramatically increased data collection, storage, and manipulation ability. As data sets have grown in size and complexity, direct &amp;quot;hands-on&amp;quot; data analysis has increasingly been augmented with indirect, automated data processing, aided by other discoveries in computer science, specially in the field of machine learning, such as neural networks, cluster analysis, genetic algorithms (1950s), decision trees and decision rules (1960s), and support vector machines (1990s). Data mining is the process of applying these methods with the intention of uncovering hidden patterns in large data sets. It bridges the gap from applied statistics and artificial intelligence (which usually provide the mathematical background) to database management by exploiting the way data is stored and indexed in databases to execute the actual learning and discovery algorithms more efficiently, allowing such methods to be applied to ever-larger data sets.&lt;br /&gt;
&lt;br /&gt;
从数据中手动提取模式的方法已经持续了好几个世纪了。早期识别数据模式的方法包括17世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;贝叶斯定理 Bayes' Theorem&amp;lt;/font&amp;gt;'''和19世纪的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归分析 Regression Analysis&amp;lt;/font&amp;gt;'''。计算机技术的扩散、其普遍性和日益强大的能力极大地提高了数据的收集、存储和操作能力。随着数据集的规模和复杂性的增长，手动分析数据的方法越来越多地被更强的间接、自动化的数据处理所取代，这都得益于计算机科学其他领域取得的新的进步，特别是机器学习领域的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;神经网络 Neural Networks&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类分析 Cluster Analysis&amp;lt;/font&amp;gt;'''、'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;遗传算法 Genetic Algorithms&amp;lt;/font&amp;gt;'''（1950年代），'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策树 Decision Tree&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;决策规则 Decision Rules&amp;lt;/font&amp;gt;'''（1960年代）以及'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;支持向量机 Support Vector Machines&amp;lt;/font&amp;gt;'''（1990年代）等。数据挖掘就是应用这些方法来发现大型数据集中的隐藏模式的过程。它利用数据在数据库中存储和索引的方式，更有效地执行实际的学习和发现算法，从而弥补了从应用统计学和人工智能(通常提供数学背景)到数据库管理之间的差距，使这些方法能够应用于更大的数据集。&lt;br /&gt;
&lt;br /&gt;
==发展过程 Process==&lt;br /&gt;
&lt;br /&gt;
The ''knowledge discovery in databases (KDD) process'' is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
The knowledge discovery in databases (KDD) process is commonly defined with the stages:&lt;br /&gt;
&lt;br /&gt;
数据库中的知识发现 Knowledge Discovery in Databases ，KDD过程通常定义为以下几个阶段:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Selection&lt;br /&gt;
&lt;br /&gt;
 Selection&lt;br /&gt;
&lt;br /&gt;
选择&lt;br /&gt;
&lt;br /&gt;
# Pre-processing&lt;br /&gt;
&lt;br /&gt;
 Pre-processing&lt;br /&gt;
&lt;br /&gt;
预处理&lt;br /&gt;
&lt;br /&gt;
# Transformation&lt;br /&gt;
&lt;br /&gt;
 Transformation&lt;br /&gt;
&lt;br /&gt;
转换&lt;br /&gt;
&lt;br /&gt;
# ''Data mining''&lt;br /&gt;
&lt;br /&gt;
 Data mining&lt;br /&gt;
&lt;br /&gt;
数据挖掘&lt;br /&gt;
&lt;br /&gt;
# Interpretation/evaluation.&amp;lt;ref name=&amp;quot;Fayyad&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
 Interpretation/evaluation.&lt;br /&gt;
&lt;br /&gt;
解释 / 评估。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the [[Cross-industry standard process for data mining]] (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
It exists, however, in many variations on this theme, such as the Cross-industry standard process for data mining (CRISP-DM) which defines six phases:&lt;br /&gt;
&lt;br /&gt;
然而，它存在于这个主题的许多变体中，例如在'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据挖掘的跨行业标准流程 Cross-industry standard process for data mining，CRISP-DM&amp;lt;/font&amp;gt;'''中它定义了以下六个阶段：&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
# Business understanding&lt;br /&gt;
&lt;br /&gt;
 Business understanding&lt;br /&gt;
&lt;br /&gt;
商业理解&lt;br /&gt;
&lt;br /&gt;
# Data understanding&lt;br /&gt;
&lt;br /&gt;
 Data understanding&lt;br /&gt;
&lt;br /&gt;
数据理解&lt;br /&gt;
&lt;br /&gt;
# Data preparation&lt;br /&gt;
&lt;br /&gt;
 Data preparation&lt;br /&gt;
&lt;br /&gt;
数据准备&lt;br /&gt;
&lt;br /&gt;
# Modeling&lt;br /&gt;
&lt;br /&gt;
 Modeling&lt;br /&gt;
&lt;br /&gt;
建模&lt;br /&gt;
&lt;br /&gt;
# Evaluation&lt;br /&gt;
&lt;br /&gt;
 Evaluation&lt;br /&gt;
&lt;br /&gt;
评估&lt;br /&gt;
&lt;br /&gt;
# Deployment&lt;br /&gt;
&lt;br /&gt;
 Deployment&lt;br /&gt;
&lt;br /&gt;
部署&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
or a simplified process such as (1) Pre-processing, (2) Data Mining, and (3) Results Validation.&lt;br /&gt;
&lt;br /&gt;
或一个简化的过程，包括：(1)预处理，(2)数据挖掘，(3)结果验证。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners.&amp;lt;ref&amp;gt;[[Gregory Piatetsky-Shapiro]] (2002) [http://www.kdnuggets.com/polls/2002/methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2004) [http://www.kdnuggets.com/polls/2004/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2007) [http://www.kdnuggets.com/polls/2007/data_mining_methodology.htm ''KDnuggets Methodology Poll''], [[Gregory Piatetsky-Shapiro]] (2014) [http://www.kdnuggets.com/polls/2014/analytics-data-mining-data-science-methodology.html ''KDnuggets Methodology Poll'']&amp;lt;/ref&amp;gt; The only other data mining standard named in these polls was [[SEMMA]]. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models,&amp;lt;ref name=&amp;quot;kurgan&amp;quot;&amp;gt;Lukasz Kurgan and Petr Musilek (2006); [http://journals.cambridge.org/action/displayAbstract?fromPage=online&amp;amp;aid=451120 ''A survey of Knowledge Discovery and Data Mining process models'']. The Knowledge Engineering Review. Volume 21 Issue 1, March 2006, pp&amp;amp;nbsp;1–24, Cambridge University Press, New York, NY, USA {{DOI|10.1017/S0269888906000737}}&amp;lt;/ref&amp;gt; and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&amp;lt;ref name=&amp;quot;AzevedoSantos&amp;quot;&amp;gt;Azevedo, A. and Santos, M. F. [http://www.iadis.net/dl/final_uploads/200812P033.pdf KDD, SEMMA and CRISP-DM: a parallel overview] {{webarchive|url=https://web.archive.org/web/20130109114939/http://www.iadis.net/dl/final_uploads/200812P033.pdf |date=2013-01-09 }}. In Proceedings of the IADIS European Conference on Data Mining 2008, pp&amp;amp;nbsp;182–185.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Polls conducted in 2002, 2004, 2007 and 2014 show that the CRISP-DM methodology is the leading methodology used by data miners. The only other data mining standard named in these polls was SEMMA. However, 3–4 times as many people reported using CRISP-DM. Several teams of researchers have published reviews of data mining process models, and Azevedo and Santos conducted a comparison of CRISP-DM and SEMMA in 2008.&lt;br /&gt;
&lt;br /&gt;
在这些调查中，唯一的其他数据挖掘标准是SEMMA。然而，使用CRISP-DM的人数是其3-4倍。一些研究小组已经发表了关于数据挖掘过程模型的研究，例如阿泽维多 Azevedo和 桑托斯Santos曾在2008年对CRISP-DM和SEMMA这两套数据挖掘流程标准进行了比较。&lt;br /&gt;
&lt;br /&gt;
===预处理 Pre-processing===&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a [[data mart]] or [[data warehouse]]. Pre-processing is essential to analyze the [[Multivariate statistics|multivariate]] data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing [[statistical noise|noise]] and those with [[missing data]].&lt;br /&gt;
&lt;br /&gt;
Before data mining algorithms can be used, a target data set must be assembled. As data mining can only uncover patterns actually present in the data, the target data set must be large enough to contain these patterns while remaining concise enough to be mined within an acceptable time limit. A common source for data is a data mart or data warehouse. Pre-processing is essential to analyze the multivariate data sets before data mining. The target set is then cleaned. Data cleaning removes the observations containing noise and those with missing data.&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须先对目标数据集进行整合。由于数据挖掘只能发现数据中实际存在的模式，目标数据集必须足够大以包含这些模式，同时保持足够简洁以便在可接受的时间限制内进行挖掘。数据的公共源是数据集市或数据仓库。在数据挖掘之前，对多变量数据集进行预处理是必不可少的。然后清理目标集。数据清理去除了包含噪声的观测值和缺失数据的观测值。&lt;br /&gt;
&lt;br /&gt;
在使用数据挖掘算法之前，必须组装目标数据集。由于数据挖掘只能发现数据中实际存在的模式，因此目标数据集必须足够大以包含这些模式，同时保持足够简洁，以便在可接受的时间限制内进行挖掘。数据的常见来源是'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据集市 Data Mart&amp;lt;/font&amp;gt;'''或'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据仓库 Data Warehouse&amp;lt;/font&amp;gt;'''。在数据挖掘之前，对'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;多元 Multivariate&amp;lt;/font&amp;gt;'''数据集进行预处理是必不可少的，然后对目标集进行清洗。数据清洗将删除包含'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;噪声 Noise&amp;lt;/font&amp;gt;'''的观测值和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;缺失数据 Missing Data&amp;lt;/font&amp;gt;'''的观测值。&lt;br /&gt;
&lt;br /&gt;
===数据挖掘 Data mining===&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&amp;lt;ref name=&amp;quot;Fayyad&amp;quot;&amp;gt;{{cite web |last1=Fayyad |first1=Usama |authorlink1=Usama Fayyad |last2=Piatetsky-Shapiro |first2=Gregory|authorlink2=Gregory Piatetsky-Shapiro |last3=Smyth |first3=Padhraic |title=From Data Mining to Knowledge Discovery in Databases |year=1996 |url=http://www.kdnuggets.com/gpspubs/aimag-kdd-overview-1996-Fayyad.pdf |accessdate = 17 December 2008 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining involves six common classes of tasks:&lt;br /&gt;
&lt;br /&gt;
数据挖掘涉及六类常见的任务:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection]] (outlier/change/deviation detection) – The identification of unusual data records, that might be interesting or data errors that require further investigation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;异常检测 Anomaly detection&amp;lt;/font&amp;gt;'''（异常值/变化/偏差检测）：识别异常数据记录，发现可能是有趣的或需要进一步调查的数据错误。&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]] (dependency modeling) – Searches for relationships between variables. For example, a supermarket might gather data on customer purchasing habits. Using association rule learning, the supermarket can determine which products are frequently bought together and use this information for marketing purposes. This is sometimes referred to as market basket analysis.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关联规则学习 Association rule learning&amp;lt;/font&amp;gt;'''（依赖关系建模）：探变量之间的关系。例如，超市可能会收集顾客购买习惯的数据。通过使用关联规则学习，超市可以确定哪些产品经常被一起购买，并将这些信息用于营销策略改进。这种研究有时被称为“市场篮子分析”。&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis|Clustering]] – is the task of discovering groups and structures in the data that are in some way or another &amp;quot;similar&amp;quot;, without using known structures in the data.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;聚类 Clustering&amp;lt;/font&amp;gt;'''：是指在数据中发现以某种方式或其他方式“相似”的组和结构，而不使用数据中已知的结构。&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]] – is the task of generalizing known structure to apply to new data. For example, an e-mail program might attempt to classify an e-mail as &amp;quot;legitimate&amp;quot; or as &amp;quot;spam&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;分类 Classification&amp;lt;/font&amp;gt;'''：是将已知结构归纳为新数据的任务。例如，电子邮件程序可能会尝试将电子邮件分类为“合法”或“垃圾邮件”。&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis|Regression]] – attempts to find a function that models the data with the least error that is, for estimating the relationships among data or datasets.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;回归&amp;lt;/font&amp;gt;'''：试图找到一个对数据建模误差最小的函数，也就是说，用于估计数据或数据集之间的关系。&lt;br /&gt;
&lt;br /&gt;
* [[Automatic summarization|Summarization]] – providing a more compact representation of the data set, including visualization and report generation.&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;自动文摘 Automatic summarizatio&amp;lt;/font&amp;gt;'''：提供数据集更紧凑、简洁的表示，包括可视化和报告生成。&lt;br /&gt;
&lt;br /&gt;
===结果验证 Results validation===&lt;br /&gt;
&lt;br /&gt;
[[File:Spurious correlations - spelling bee spiders.svg|thumb|An example of data produced by [[data dredging]] through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence. 一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。]]&lt;br /&gt;
&lt;br /&gt;
An example of data produced by data dredging through a bot operated by statistician Tyler Vigen, apparently showing a close link between the best word winning a spelling bee competition and the number of people in the United States killed by venomous spiders. The similarity in trends is obviously a coincidence.&lt;br /&gt;
&lt;br /&gt;
一个由统计学家泰勒·维根 Tyler Vigen操作的机器人进行数据挖掘所产生的数据，显然表明在拼字比赛中获胜的最佳单词与美国被毒蜘蛛杀死的人数之间有着密切的联系。但是显然这种趋势上的相似仅仅是一个巧合。&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be [[Reproducibility|reproduced]] on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper [[statistical hypothesis testing]]. A simple version of this problem in [[machine learning]] is known as [[overfitting]], but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&amp;lt;ref name=hawkins&amp;gt;{{cite journal | last1 = Hawkins | first1 = Douglas M | year = 2004 | title = The problem of overfitting | url = | journal = Journal of Chemical Information and Computer Sciences | volume = 44 | issue = 1| pages = 1–12 | doi=10.1021/ci0342472| pmid = 14741005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining can unintentionally be misused, and can then produce results that appear to be significant; but which do not actually predict future behavior and cannot be reproduced on a new sample of data and bear little use. Often this results from investigating too many hypotheses and not performing proper statistical hypothesis testing. A simple version of this problem in machine learning is known as overfitting, but the same problem can arise at different phases of the process and thus a train/test split—when applicable at all—may not be sufficient to prevent this from happening.&lt;br /&gt;
&lt;br /&gt;
数据挖掘可能会在无意中被误用，然后产生看似重要的结果; 但这些结果实际上并不能用来预测未来的行为，也不能在新的数据样本上进行复现，而且用处不大。这通常是由于调查了太多的假设，而没有进行适当的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;统计假设检验 Statistical Hypothesis Testing&amp;lt;/font&amp;gt;'''。在机器学习中，这种问题可以被简称为'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''，但相同的问题可能会在过程的不同阶段出现，因此，在完全适用的情况下，合理进行训练/测试分割这一种方法可能不足以防止这种情况的发生。&lt;br /&gt;
&lt;br /&gt;
{{Missing information|section|non-classification tasks in data mining. It only covers [[machine learning]]|date=September 2011}}&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called [[overfitting]]. To overcome this, the evaluation uses a [[test set]] of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a [[training set]] of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had ''not'' been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as [[Receiver operating characteristic|ROC curves]].&lt;br /&gt;
&lt;br /&gt;
The final step of knowledge discovery from data is to verify that the patterns produced by the data mining algorithms occur in the wider data set. Not all patterns found by data mining algorithms are necessarily valid. It is common for data mining algorithms to find patterns in the training set which are not present in the general data set. This is called overfitting. To overcome this, the evaluation uses a test set of data on which the data mining algorithm was not trained. The learned patterns are applied to this test set, and the resulting output is compared to the desired output. For example, a data mining algorithm trying to distinguish &amp;quot;spam&amp;quot; from &amp;quot;legitimate&amp;quot; emails would be trained on a training set of sample e-mails. Once trained, the learned patterns would be applied to the test set of e-mails on which it had not been trained. The accuracy of the patterns can then be measured from how many e-mails they correctly classify. Several statistical methods may be used to evaluate the algorithm, such as ROC curves.&lt;br /&gt;
&lt;br /&gt;
从数据中发现知识的最后一步是验证数据挖掘算法产生的模式是否存在于更广泛的数据集中。数据挖掘算法发现的并非所有模式都是有效的，因为对于数据挖掘算法来说，在训练集中发现一般数据集中没有的模式是很常见的，这叫做'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;过拟合 Overfitting&amp;lt;/font&amp;gt;'''。为了克服这个问题，评估使用一组测试数据，而数据挖掘算法并没有在这些测试数据上进行训练。然后将学习到的模式应用到这个'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;测试集 Test Set&amp;lt;/font&amp;gt;'''中，并将结果输出与期望的输出进行比较。例如，试图区分“垃圾邮件”和“合法”邮件的数据挖掘算法将根据一组电子邮件'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;训练集 Training Sett&amp;lt;/font&amp;gt;'''样本进行训练。训练完毕后，学到的模式将应用于未经训练的那部分电子邮件测试集数据上。然后，可以从这些模式正确分类的电子邮件数量来衡量这些模式的准确性。可以使用几种统计方法可以用来评估算法，如'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;ROC 曲线 ROC curves&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
If the learned patterns do not meet the desired standards, subsequently it is necessary to re-evaluate and change the pre-processing and data mining steps. If the learned patterns do meet the desired standards, then the final step is to interpret the learned patterns and turn them into knowledge.&lt;br /&gt;
&lt;br /&gt;
如果学习的模式不能达到预期的标准，那么就需要重新评估和修改预处理和数据挖掘的步骤。如果所学的模式确实符合所需的标准，那么最后一步就是对习得的模式进行解释并将其转化为知识。&lt;br /&gt;
&lt;br /&gt;
==研究 Research==&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the [[Association for Computing Machinery]]'s (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining ([[SIGKDD]]).&amp;lt;ref&amp;gt;{{cite web|url=http://academic.research.microsoft.com/?SearchDomain=2&amp;amp;SubDomain=7&amp;amp;entitytype=2|title=Microsoft Academic Search: Top conferences in data mining | publisher=[[Microsoft Academic Search]]}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|url=https://scholar.google.de/citations?view_op=top_venues&amp;amp;hl=en&amp;amp;vq=eng_datamininganalysis|title=Google Scholar: Top publications - Data Mining &amp;amp; Analysis|publisher=[[Google Scholar]]}}&amp;lt;/ref&amp;gt; Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings,&amp;lt;ref&amp;gt;[http://www.kdd.org/conferences.php Proceedings] {{Webarchive|url=https://web.archive.org/web/20100430120252/http://www.kdd.org/conferences.php |date=2010-04-30 }}, International Conferences on Knowledge Discovery and Data Mining, ACM, New York.&amp;lt;/ref&amp;gt; and since 1999 it has published a biannual [[academic journal]] titled &amp;quot;SIGKDD Explorations&amp;quot;.&amp;lt;ref&amp;gt;[http://www.kdd.org/explorations/about.php SIGKDD Explorations], ACM, New York.&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The premier professional body in the field is the Association for Computing Machinery's (ACM) Special Interest Group (SIG) on Knowledge Discovery and Data Mining (SIGKDD). Since 1989, this ACM SIG has hosted an annual international conference and published its proceedings, and since 1999 it has published a biannual academic journal titled &amp;quot;SIGKDD Explorations&amp;quot;.&lt;br /&gt;
&lt;br /&gt;
该领域的首要专业机构是计算机协会 ACM的知识发现和数据挖掘特别兴趣小组 SIGKDD。自1989年以来，ACM SIG每年举办一次国际会议并出版会议记录，自1999年起，它还出版了一份名为“SIGKDD探索”的两年期学术期刊。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
Computer science conferences on data mining include:&lt;br /&gt;
&lt;br /&gt;
关于数据挖掘的计算机科学会议包括:&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[CIKM Conference]] – ACM [[Conference on Information and Knowledge Management]]&lt;br /&gt;
&lt;br /&gt;
CIKM会议 ：ACM'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;信息和知识管理会议 Conference on Information and Knowledge Management&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
* [[European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases]]&lt;br /&gt;
&lt;br /&gt;
'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;欧洲机器学习与数据库知识发现原理与实践会议 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
* [[KDD Conference]] – ACM SIGKDD [[Conference on Knowledge Discovery and Data Mining]]&lt;br /&gt;
&lt;br /&gt;
KDD会议：ACM SIGKDD的'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;知识发现与数据挖掘会议 Conference on Knowledge Discovery and Data Mining&amp;lt;/font&amp;gt;'''&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many [[List of computer science conferences#Data Management|data management/database conferences]] such as the ICDE Conference, [[SIGMOD|SIGMOD Conference]] and [[International Conference on Very Large Data Bases]]&lt;br /&gt;
&lt;br /&gt;
Data mining topics are also present on many data management/database conferences such as the ICDE Conference, SIGMOD Conference and International Conference on Very Large Data Bases.&lt;br /&gt;
&lt;br /&gt;
数据挖掘专题也出现在许多数据管理/数据库会议上，如 ICDE会议、 '''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;SIGMOD会议 SIGMOD Conference&amp;lt;/font&amp;gt;'''和'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;关于超大数据库国际会议International Conference on Very Large Data Bases&amp;lt;/font&amp;gt;'''。&lt;br /&gt;
&lt;br /&gt;
==标准 Standards==&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European [[Cross Industry Standard Process for Data Mining]] (CRISP-DM 1.0) and the 2004 [[Java Data Mining]] standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
There have been some efforts to define standards for the data mining process, for example, the 1999 European Cross Industry Standard Process for Data Mining (CRISP-DM 1.0) and the 2004 Java Data Mining standard (JDM 1.0). Development on successors to these processes (CRISP-DM 2.0 and JDM 2.0) was active in 2006 but has stalled since. JDM 2.0 was withdrawn without reaching a final draft.&lt;br /&gt;
&lt;br /&gt;
为数据挖掘过程定义了一些标准，例如1999年欧洲跨行业数据挖掘标准流程（CRISP-DM 1.0）和2004年Java数据挖掘标准（JDM 1.0）。这些程序的后续程序（CRISP-DM 2.0和 JDM 2.0）的开发活跃于2006年，但此后一直停滞不前。Jdm 2.0没有达成最终草案就被撤销了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in [[predictive analytics]]&amp;amp;nbsp;– the key standard is the [[Predictive Model Markup Language]] (PMML), which is an [[XML]]-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) [[subspace clustering]] have been proposed independently of the DMG.&amp;lt;ref&amp;gt;{{Cite book | last1 = Günnemann | first1 = Stephan | last2 = Kremer | first2 = Hardy | last3 = Seidl | first3 = Thomas | doi = 10.1145/2023598.2023605 | chapter = An extension of the PMML standard to subspace clustering models | title = Proceedings of the 2011 workshop on Predictive markup language modeling - PMML '11 | pages = 48 | year = 2011 | isbn = 978-1-4503-0837-3 | pmid =  | pmc = }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
For exchanging the extracted models – in particular for use in predictive analytics&amp;amp;nbsp;– the key standard is the Predictive Model Markup Language (PMML), which is an XML-based language developed by the Data Mining Group (DMG) and supported as exchange format by many data mining applications. As the name suggests, it only covers prediction models, a particular data mining task of high importance to business applications. However, extensions to cover (for example) subspace clustering have been proposed independently of the DMG.&lt;br /&gt;
&lt;br /&gt;
为了交换所提取的模型，特别是在预测分析中使用，关键的标准是预测模型标记语言 PMML，这是一种基于 XML 的语言，由数据挖掘集团 DMG 开发，并支持作为交换格式的许多数据挖掘应用程序。顾名思义，它只涵盖预测模型，这是一项对业务应用程序非常重要的特殊数据挖掘任务。然而，覆盖子空间聚类的扩展已经独立于 DMG 被提出。&lt;br /&gt;
&lt;br /&gt;
==显著用途 Notable uses==&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable [[examples of data mining]] can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
Data mining is used wherever there is digital data available today. Notable examples of data mining can be found throughout business, medicine, science, and surveillance.&lt;br /&gt;
&lt;br /&gt;
数据挖掘在任何有数字数据可用的地方都可以被使用。数据挖掘的著名例子可以在商业、医学、科学和监控领域找到。&lt;br /&gt;
&lt;br /&gt;
==隐私问题和道德规范 Privacy concerns and ethics==&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&amp;lt;ref&amp;gt;{{cite journal |author=Seltzer, William |title=The Promise and Pitfalls of Data Mining: Ethical Issues |url=https://ww2.amstat.org/committees/ethics/linksdir/Jsm2005Seltzer.pdf|publisher = American Statistical Association|journal = ASA Section on Government Statistics|date = 2005 }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
While the term &amp;quot;data mining&amp;quot; itself may have no ethical implications, it is often associated with the mining of information in relation to peoples' behavior (ethical and otherwise).&lt;br /&gt;
&lt;br /&gt;
虽然“数据挖掘”这个术语本身可能没有伦理含义，但它通常与人们行为（伦理和其他）相关的信息挖掘有关。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding [[privacy]], legality, and ethics.&amp;lt;ref&amp;gt;{{cite journal |author=Pitts, Chip |title=The End of Illegal Domestic Spying? Don't Count on It |url=http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |journal=Washington Spectator |date=15 March 2007 |url-status=dead |archiveurl=https://web.archive.org/web/20071128015201/http://www.washingtonspectator.com/articles/20070315surveillance_1.cfm |archivedate=2007-11-28 }}&amp;lt;/ref&amp;gt; In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the [[Total Information Awareness]] Program or in [[ADVISE]], has raised privacy concerns.&amp;lt;ref&amp;gt;{{cite journal |author=Taipale, Kim A. |title=Data Mining and Domestic Security: Connecting the Dots to Make Sense of Data |url=http://www.stlr.org/cite.cgi?volume=5&amp;amp;article=2 |journal=Columbia Science and Technology Law Review |volume=5 |issue=2 |date=15 December 2003 |ssrn=546782 |oclc=45263753 }}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;{{cite web|last1=Resig|first1=John|title=A Framework for Mining Instant Messaging Services|url=https://johnresig.com/files/research/SIAMPaper.pdf|accessdate=16 March 2018}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The ways in which data mining can be used can in some cases and contexts raise questions regarding privacy, legality, and ethics. In particular, data mining government or commercial data sets for national security or law enforcement purposes, such as in the Total Information Awareness Program or in ADVISE, has raised privacy concerns.&lt;br /&gt;
&lt;br /&gt;
在某些情况下，数据挖掘的使用方式可能会引发隐私、合法性和伦理问题。特别是，为国家安全或执法目的而进行的政府或商业数据集的数据挖掘，如在全面信息意识项目或在 ADVISE 中，引起了隐私问题。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through [[aggregate function|data aggregation]]. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent).&amp;lt;ref name=&amp;quot;NASCIO&amp;quot;&amp;gt;[http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf ''Think Before You Dig: Privacy Implications of Data Mining &amp;amp; Aggregation''] {{webarchive|url=https://web.archive.org/web/20081217063043/http://www.nascio.org/publications/documents/NASCIO-dataMining.pdf |date=2008-12-17 }}, NASCIO Research Brief, September 2004&amp;lt;/ref&amp;gt; This is not data mining ''per se'', but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&amp;lt;ref&amp;gt;{{cite magazine |first=Paul |last=Ohm |title=Don't Build a Database of Ruin |magazine=Harvard Business Review |url=http://blogs.hbr.org/cs/2012/08/dont_build_a_database_of_ruin.html}}&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/12/03/iron-cagebook/ Iron Cagebook - The Logical End of Facebook's Patents], [[Counterpunch.org]], 2013.12.03&amp;lt;/ref&amp;gt;&amp;lt;ref&amp;gt;Darwin Bond-Graham, [http://www.counterpunch.org/2013/09/11/inside-the-tech-industrys-startup-conference/ Inside the Tech industry's Startup Conference], [[Counterpunch.org]], 2013.09.11&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data mining requires data preparation which uncovers information or patterns which compromise confidentiality and privacy obligations. A common way for this to occur is through data aggregation. Data aggregation involves combining data together (possibly from various sources) in a way that facilitates analysis (but that also might make identification of private, individual-level data deducible or otherwise apparent). This is not data mining per se, but a result of the preparation of data before – and for the purposes of – the analysis. The threat to an individual's privacy comes into play when the data, once compiled, cause the data miner, or anyone who has access to the newly compiled data set, to be able to identify specific individuals, especially when the data were originally anonymous.&lt;br /&gt;
&lt;br /&gt;
数据挖掘需要进行数据准备，以发现损害机密性和隐私义务的信息或模式。实现这一点的一种常见方式是通过'''&amp;lt;font color=&amp;quot;#ff8000&amp;quot;&amp;gt;数据聚合 Data Aggregation&amp;lt;/font&amp;gt;'''。数据聚合包括以一种便于分析的方式将数据（可能来自不同的来源）组合在一起（但这也可能使私人、个人级别的数据的识别变得可推断或以其他方式显而易见）。但这并不是数据挖掘本身，而是在分析之前以及为分析目的准备数据的结果。当数据被编译后，数据挖掘者或任何有权访问新编译的数据集的人能够识别特定的个人，特别是当数据最初是匿名的时，对个人隐私的威胁就开始发挥作用了。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
It is recommended{{whom|date=August 2019}} to be aware of the following '''before''' data are collected:&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt;&lt;br /&gt;
&lt;br /&gt;
It is recommended to be aware of the following before data are collected:&lt;br /&gt;
&lt;br /&gt;
在收集数据之前，建议注意以下事项:&lt;br /&gt;
&lt;br /&gt;
* The purpose of the data collection and any (known) data mining projects;&lt;br /&gt;
&lt;br /&gt;
数据收集和任何（已知的）数据挖掘项目的目的；&lt;br /&gt;
&lt;br /&gt;
* How the data will be used;&lt;br /&gt;
&lt;br /&gt;
数据使用的方法；&lt;br /&gt;
&lt;br /&gt;
* Who will be able to mine the data and use the data and their derivatives;&lt;br /&gt;
&lt;br /&gt;
谁将能够挖掘数据并使用这些数据及其衍生工具；&lt;br /&gt;
&lt;br /&gt;
* The status of security surrounding access to the data;&lt;br /&gt;
&lt;br /&gt;
数据访问的安全状态；&lt;br /&gt;
&lt;br /&gt;
* How collected data can be updated.&lt;br /&gt;
&lt;br /&gt;
如何更新收集的数据。&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to ''become'' anonymous, so that individuals may not readily be identified.&amp;lt;ref name=&amp;quot;NASCIO&amp;quot; /&amp;gt; However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&amp;lt;ref&amp;gt;[http://www.securityfocus.com/brief/277 ''AOL search data identified individuals''], SecurityFocus, August 2006&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Data may also be modified so as to become anonymous, so that individuals may not readily be identified.However, even &amp;quot;&amp;quot;anonymized&amp;quot; data sets can potentially contain enough information to allow identification of individuals, as occurred when journalists were able to find several individuals based on a set of search histories that were inadvertently released by AOL.&lt;br /&gt;
&lt;br /&gt;
数据也可以被修改成匿名的，这样个人就不容易被修改了确定。但是，甚至“匿名化”的数据集也可能包含足够的信息用来识别个人，就像记者能够根据一组无意中搜索历史找到几个个人一样美国在线发布。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of [[personally identifiable information]] leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of [[privacy violation]], the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&amp;lt;ref&amp;gt;{{Cite journal|title = Big data׳s impact on privacy, security and consumer welfare|journal = Telecommunications Policy|pages = 1134–1145|volume = 38|issue = 11|doi = 10.1016/j.telpol.2014.10.002|first = Nir|last = Kshetri|year = 2014|url = http://libres.uncg.edu/ir/uncg/f/N_Kshetri_Big_2014.pdf}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The inadvertent revelation of personally identifiable information leading to the provider violates Fair Information Practices.   This indiscretion can cause financial, emotional, or bodily harm to the indicated individual.  In one instance of privacy violation, the patrons of Walgreens filed a lawsuit against the company in 2011 for selling prescription information to data mining companies who in turn provided the data to pharmaceutical companies.&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
无意中泄露个人身份信息导致提供者违反了公平信息惯例。这种轻率的行为会对指定的个人造成经济、情感或身体伤害。在一起侵犯隐私的案例中，沃尔格林 Walgreens的赞助人在2011年对该公司提起诉讼，指控该公司向数据挖掘公司出售处方信息，而数据挖掘公司又将这些数据提供给制药公司。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲的情况 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[European Union|Europe]] has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the [[International Safe Harbor Privacy Principles|U.S.-E.U. Safe Harbor Principles]], developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of [[Edward Snowden]]'s [[global surveillance disclosure]], there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the [[National Security Agency]], and attempts to reach an agreement with the United States have failed.&amp;lt;ref&amp;gt;{{cite web |url=https://crsreports.congress.gov/product/pdf/R/R44257/7 |title=U.S.-E.U. Data Privacy: From Safe Harbor to Privacy Shield |last1=Weiss |first1=Martin A. |last2=Archick |first2=Kristin |date=19 May 2016 |department= |website= |series= |agency=Congressional Research Service |location=Washington, D.C. |page=6 |pages= |format=PDF |id=R44257 |access-date=9 April 2020 |quote=On October 6, 2015, the [[Court of Justice of the European Union|CJEU]]&amp;amp;nbsp;... issued a decision that invalidated Safe Harbor (effective immediately), as currently implemented. }}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
Europe has rather strong privacy laws, and efforts are underway to further strengthen the rights of the consumers. However, the U.S.-E.U. Safe Harbor Principles, developed between 1998 and 2000, currently effectively expose European users to privacy exploitation by U.S. companies. As a consequence of Edward Snowden's global surveillance disclosure, there has been increased discussion to revoke this agreement, as in particular the data will be fully exposed to the National Security Agency, and attempts to reach an agreement with the United States have failed.&lt;br /&gt;
&lt;br /&gt;
欧洲有相当强的隐私法，正在努力进一步加强消费者的权利。然而，1998年至2000年期间制定的《美国-欧盟安全港原则》（U.S.-E.U.Safe Harbor Principles）目前有效地使欧洲用户受到美国公司的隐私剥削。由于爱德华·斯诺登 Edward Snowden披露了全球监控信息后，关于撤销这一协议的讨论越来越多，尤其是数据将完全暴露给国家安全局，与美国达成协议的尝试也失败了。&lt;br /&gt;
&lt;br /&gt;
===美国的情况 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the [[US Congress]] via the passage of regulatory controls such as the [[Health Insurance Portability and Accountability Act]] (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in ''Biotech Business Week'', &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot;&amp;lt;ref&amp;gt;Biotech Business Week Editors (June 30, 2008); ''BIOMEDICINE; HIPAA Privacy Rule Impedes Biomedical Research'', Biotech Business Week, retrieved 17 November 2009 from LexisNexis Academic&amp;lt;/ref&amp;gt; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
In the United States, privacy concerns have been addressed by the US Congress via the passage of regulatory controls such as the Health Insurance Portability and Accountability Act (HIPAA). The HIPAA requires individuals to give their &amp;quot;informed consent&amp;quot; regarding information they provide and its intended present and future uses. According to an article in Biotech Business Week, &amp;quot;'[i]n practice, HIPAA may not offer any greater protection than the longstanding regulations in the research arena,' says the AAHC. More importantly, the rule's goal of protection through informed consent is approach a level of incomprehensibility to average individuals.&amp;quot; This underscores the necessity for data anonymity in data aggregation and mining practices.&lt;br /&gt;
&lt;br /&gt;
在美国，美国国会通过了《健康保险便携性和责任法案》（HIPAA）等监管措施，解决了隐私问题。HIPAA要求个人就其提供的信息及其当前和未来的预期用途给予“知情同意”。根据《生物技术商业周刊》的一篇文章，“在实践中，HIPAA可能不会比研究领域长期存在的法规提供更大的保护。”。更重要的是，该规则通过知情同意进行保护的目标是接近普通个人的不可理解程度。”这突出了数据聚合和挖掘实践中数据匿名的必要性。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the [[Family Educational Rights and Privacy Act]] (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
U.S. information privacy legislation such as HIPAA and the Family Educational Rights and Privacy Act (FERPA) applies only to the specific areas that each such law addresses. The use of data mining by the majority of businesses in the U.S. is not controlled by any legislation.&lt;br /&gt;
&lt;br /&gt;
美国信息隐私立法，如 HIPAA 和《家庭教育权利和隐私法》（FERPA）仅适用于每一个此类法律所涉及的特定领域。美国大多数企业对数据挖掘的使用并不受任何法律的控制。&lt;br /&gt;
&lt;br /&gt;
== 数据挖掘与著作权法 Copyright law==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===欧洲 Situation in Europe===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Under [[Copyright law of the European Union|European copyright]] and [[Database Directive|database law]]s, the mining of in-copyright works (such as by [[web mining]]) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright{{snd}} but database rights may exist so data mining becomes subject to [[intellectual property]] owners' rights that are protected by the [[Database Directive]]. On the recommendation of the [[Hargreaves review]], this led to the UK government to amend its copyright law in 2014 to allow content mining as a [[Limitations and exceptions to copyright|limitation and exception]].&amp;lt;ref&amp;gt;[http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ UK Researchers Given Data Mining Right Under New UK Copyright Laws.] {{webarchive |url=https://web.archive.org/web/20140609020315/http://www.out-law.com/en/articles/2014/june/researchers-given-data-mining-right-under-new-uk-copyright-laws/ |date=June 9, 2014 }} ''Out-Law.com.''   Retrieved 14 November 2014&amp;lt;/ref&amp;gt; The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the [[Information Society Directive]] (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
Under European copyright and database laws, the mining of in-copyright works (such as by web mining) without the permission of the copyright owner is not legal. Where a database is pure data in Europe, it may be that there is no copyright but database rights may exist so data mining becomes subject to intellectual property owners' rights that are protected by the Database Directive. On the recommendation of the Hargreaves review, this led to the UK government to amend its copyright law in 2014 to allow content mining as a limitation and exception. The UK was the second country in the world to do so after Japan, which introduced an exception in 2009 for data mining. However, due to the restriction of the Information Society Directive (2001), the UK exception only allows content mining for non-commercial purposes. UK copyright law also does not allow this provision to be overridden by contractual terms and conditions. &lt;br /&gt;
&lt;br /&gt;
根据欧洲版权法和数据库法，未经版权所有人许可而对版权作品进行挖掘（如通过网络挖掘）是不合法的。在欧洲，如果数据库是纯数据，可能没有版权，但数据库权利可能存在，因此数据挖掘受数据库指令保护的知识产权所有者的权利约束。根据《哈格里夫斯评论》（Hargreaves review）的建议，这导致英国政府在2014年修订了版权法，允许将内容挖掘作为一种限制和例外。英国是继日本之后世界上第二个这样做的国家，日本在2009年引入了数据挖掘的例外。然而，由于信息社会指令（2001年）的限制，英国是例外情况但是只允许非商业目的的内容挖掘。英国版权法也不允许合同条款和条件推翻这一规定。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
The [[European Commission]] facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe.&amp;lt;ref&amp;gt;{{cite web|title=Licences for Europe - Structured Stakeholder Dialogue 2013|url=http://ec.europa.eu/licences-for-europe-dialogue/en/content/about-site|website=European Commission|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt; The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and [[open access]] publishers to leave the stakeholder dialogue in May 2013.&amp;lt;ref&amp;gt;{{cite web|title=Text and Data Mining:Its importance and the need for change in Europe|url=http://libereurope.eu/news/text-and-data-mining-its-importance-and-the-need-for-change-in-europe/|website=Association of European Research Libraries|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
The European Commission facilitated stakeholder discussion on text and data mining in 2013, under the title of Licences for Europe. The focus on the solution to this legal issue, such as licensing rather than limitations and exceptions, led to representatives of universities, researchers, libraries, civil society groups and open access publishers to leave the stakeholder dialogue in May 2013.&lt;br /&gt;
&lt;br /&gt;
2013年，欧盟委员会以“欧洲许可证”为题，推动了利益相关者对文本和数据挖掘的讨论。但他们将重点放在解决这一法律问题上，如许可证而不是限制和例外，导致大学、研究人员、图书馆、民间社会团体和开放获取出版商的代表于2013年5月离开了利益相关者对话。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===美国 Situation in the United States===&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
[[Copyright law of the United States|US copyright law]], and in particular its provision for [[fair use]], upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the [[Google Book Search Settlement Agreement|Google Book settlement]] the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&amp;lt;ref&amp;gt;{{cite web|title=Judge grants summary judgment in favor of Google Books — a fair use victory|url=http://www.lexology.com/library/detail.aspx?g=a18c5b92-5a20-4d1d-a098-a3095046a88e|website=Lexology.com|publisher=Antonelli Law Ltd|accessdate=14 November 2014}}&amp;lt;/ref&amp;gt;&lt;br /&gt;
&lt;br /&gt;
US copyright law, and in particular its provision for fair use, upholds the legality of content mining in America, and other fair use countries such as Israel, Taiwan and South Korea. As content mining is transformative, that is it does not supplant the original work, it is viewed as being lawful under fair use. For example, as part of the Google Book settlement the presiding judge on the case ruled that Google's digitization project of in-copyright books was lawful, in part because of the transformative uses that the digitization project displayed - one being text and data mining.&lt;br /&gt;
&lt;br /&gt;
美国版权法，特别是其中关于合理使用的条款，支持在美国和其他合理使用国家，如以色列，台湾和韩国采矿内容的合法性。由于内容挖掘是变革性的，也就是说，它不会取代原来的工作，它被视为合法的合理使用。例如，作为谷歌图书和解协议的一部分，此案的主审法官裁定，谷歌版权图书数字化项目是合法的，部分原因在于数字化项目所展示的变革性用途——其中之一就是文本和数据挖掘。&lt;br /&gt;
&lt;br /&gt;
==软件 Software==&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Data mining and machine learning software}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===开源的数据挖掘软件 Free open-source data mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under free/open-source licenses. Public access to application source code is also available.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以使用免费 / 开源许可证。应用程序源代码也是对公众开放访问的。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Carrot2]]: Text and search results clustering framework.  文本和搜索结果聚类框架。&lt;br /&gt;
&lt;br /&gt;
* [[Chemicalize.org]]: A chemical structure miner and web search engine.  化学结构挖掘与网络搜索引擎。&lt;br /&gt;
&lt;br /&gt;
* [[ELKI]]: A university research project with advanced [[cluster analysis]] and [[anomaly detection|outlier detection]] methods written in the [[Java (programming language)|Java]] language.  一个大学研究项目，用Java语言编写高级聚类分析和离群点检测方法。&lt;br /&gt;
&lt;br /&gt;
* [[General Architecture for Text Engineering|GATE]]: a [[natural language processing]] and language engineering tool.  一个自然语言处理和语言工程工具。&lt;br /&gt;
&lt;br /&gt;
* [[KNIME]]: The Konstanz Information Miner, a user-friendly and comprehensive data analytics framework.  Konstanz Information Miner，一个用户友好的综合数据分析框架。&lt;br /&gt;
&lt;br /&gt;
* [[MOA (Massive Online Analysis)|Massive Online Analysis (MOA)]]: a real-time big data stream mining with concept drift tool in the [[Java (programming language)|Java]] programming language.  利用Java语言中的概念漂移工具进行实时大数据流挖掘。&lt;br /&gt;
&lt;br /&gt;
* [[Multi expression programming|MEPX]] - cross-platform tool for regression and classification problems based on a Genetic Programming variant.  基于遗传编程变量的回归和分类问题的跨平台工具。&lt;br /&gt;
&lt;br /&gt;
* ML-Flex: A software package that enables users to integrate with third-party machine-learning packages written in any programming language, execute classification analyses in parallel across multiple computing nodes, and produce HTML reports of classification results.  一种软件包，使用户能够与用任何编程语言编写的第三方机器学习包集成，跨多个计算节点并行执行分类分析，并生成分类结果的HTML报告。&lt;br /&gt;
&lt;br /&gt;
* [[mlpack]]: a collection of ready-to-use machine learning algorithms written in the [[C++]] language. 一个用C++语言编写的机器学习算法的集合。&lt;br /&gt;
&lt;br /&gt;
* [[NLTK]] ([[Natural Language Toolkit]]): A suite of libraries and programs for symbolic and statistical natural language processing (NLP) for the [[Python (programming language)|Python]] language.  一套用于Python语言的符号和统计自然语言处理（NLP）的库和程序。&lt;br /&gt;
&lt;br /&gt;
* [[OpenNN]]: Open [[neural networks]] library.  开源的神经网络库。&lt;br /&gt;
&lt;br /&gt;
* [[Orange (software)|Orange]]: A component-based data mining and [[machine learning]] software suite written in the [[Python (programming language)|Python]] language. 一个用Python语言编写的基于组件的数据挖掘和机器学习软件套件。&lt;br /&gt;
&lt;br /&gt;
* [[R (programming language)|R]]: A [[programming language]] and software environment for [[statistics|statistical]] computing, data mining, and graphics. It is part of the [[GNU Project]]. 一种用于统计计算、数据挖掘和图形的编程语言和软件环境。它是GNU项目的一部分。&lt;br /&gt;
&lt;br /&gt;
* [[scikit-learn]] is an open-source machine learning library for the Python programming language  是Python编程语言的一个开源机器学习库&lt;br /&gt;
&lt;br /&gt;
* [[Torch (machine learning)|Torch]]: An [[open source model|open-source]] [[deep learning]] library for the [[Lua (programming language)|Lua]] programming language and [[scientific computing]] framework with wide support for [[machine learning]] algorithms.  一个开源的深度学习lib库语言和科学计算框架，广泛支持机器学习算法。&lt;br /&gt;
&lt;br /&gt;
* [[UIMA]]: The UIMA (Unstructured Information Management Architecture) is a component framework for analyzing unstructured content such as text, audio and video – originally developed by IBM.  UIMA（非结构化信息管理体系结构）是一个用于分析非结构化内容（如文本、音频和视频）的组件框架，最初由IBM开发。&lt;br /&gt;
&lt;br /&gt;
* [[Weka (machine learning)|Weka]]: A suite of machine learning software applications written in the [[Java (programming language)|Java]] programming language.  用Java编程语言编写的一套机器学习软件应用程序。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
===需要专有许可的数据挖掘软件和应用程序 Proprietary data-mining software and applications===&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
The following applications are available under proprietary licenses.&lt;br /&gt;
&lt;br /&gt;
下面的应用程序可以根据专有许可证提供。&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
* [[Angoss]] KnowledgeSTUDIO: data mining tool  数据挖掘工具。&lt;br /&gt;
&lt;br /&gt;
* [[LIONsolver]]: an integrated software application for data mining, business intelligence, and modeling that implements the Learning and Intelligent OptimizatioN (LION) approach.  用于数据挖掘、商业智能和建模的集成软件应用程序，实现学习和智能优化（LION）方法。&lt;br /&gt;
&lt;br /&gt;
* Megaputer Intelligence: data and text mining software is called PolyAnalyst.  数据和文本挖掘软件PolyAnalyst。&lt;br /&gt;
&lt;br /&gt;
* [[Microsoft Analysis Services]]: data mining software provided by [[Microsoft]].  微软提供的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[NetOwl]]: suite of multilingual text and entity analytics products that enable data mining.  支持数据挖掘的多语言文本和实体分析产品套件。&lt;br /&gt;
&lt;br /&gt;
* [[Oracle Data Mining]]: data mining software by [[Oracle Corporation]].  Oracle公司的数据挖掘软件&lt;br /&gt;
&lt;br /&gt;
* [[PSeven]]: platform for automation of engineering simulation and analysis, multidisciplinary optimization and data mining provided by [[DATADVANCE]].  DATADVANCE为工程仿真分析、多学科优化和数据挖掘提供自动化平台。&lt;br /&gt;
&lt;br /&gt;
* [[Qlucore]] Omics Explorer: data mining software.  数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[RapidMiner]]: An environment for [[machine learning]] and data mining experiments. &amp;lt;!-- Latest version is NOT opensource --&amp;gt;  一个用于机器学习和数据挖掘实验的环境。&lt;br /&gt;
&lt;br /&gt;
* [[SAS (software)#Components|SAS Enterprise Miner]]: data mining software provided by the [[SAS Institute]].  SAS机构提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[SPSS Modeler]]: data mining software provided by [[IBM]].  IBM提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[STATISTICA]] Data Miner: data mining software provided by [[StatSoft]].  StatSoft提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
* [[Tanagra (machine learning)|Tanagra]]: Visualisation-oriented data mining software, also for teaching.  面向可视化的数据挖掘软件，也用于教学。&lt;br /&gt;
&lt;br /&gt;
* [[Vertica]]: data mining software provided by [[Hewlett-Packard]].  惠普提供的数据挖掘软件。&lt;br /&gt;
&lt;br /&gt;
==扩展链接 See also==&lt;br /&gt;
&lt;br /&gt;
; Methods&lt;br /&gt;
&lt;br /&gt;
方法&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Agent mining]]  主体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Anomaly detection|Anomaly/outlier/change detection]]  异常/异常/变化检测&lt;br /&gt;
&lt;br /&gt;
* [[Association rule learning]]  关联规则学习&lt;br /&gt;
&lt;br /&gt;
* [[Bayesian network]]s  贝叶斯网络&lt;br /&gt;
&lt;br /&gt;
* [[Statistical classification|Classification]]  分类&lt;br /&gt;
&lt;br /&gt;
* [[Cluster analysis]]  聚类分析&lt;br /&gt;
&lt;br /&gt;
* [[Decision tree]]s  决策树&lt;br /&gt;
&lt;br /&gt;
* [[Ensemble learning]]  集成学习&lt;br /&gt;
&lt;br /&gt;
* [[Factor analysis]]  因子分析&lt;br /&gt;
&lt;br /&gt;
* [[Genetic algorithms]]  遗传算法&lt;br /&gt;
&lt;br /&gt;
* [[Intention mining]]  意向玩具&lt;br /&gt;
&lt;br /&gt;
* [[Learning classifier system]]  学习分类器系统&lt;br /&gt;
&lt;br /&gt;
* [[Multilinear subspace learning]]  多线性子空间学习&lt;br /&gt;
&lt;br /&gt;
* [[Artificial neural network|Neural network]]s  神经网络&lt;br /&gt;
&lt;br /&gt;
* [[Regression analysis]]  回归分析&lt;br /&gt;
&lt;br /&gt;
* [[Sequence mining]]   序列挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Structured data analysis (statistics)|Structured data analysis]]  结构数据学习&lt;br /&gt;
&lt;br /&gt;
* [[Support vector machines]]  支持向量机&lt;br /&gt;
&lt;br /&gt;
* [[Text mining]]  文本挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Time series|Time series analysis]]  时间序列分析&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application domains&lt;br /&gt;
&lt;br /&gt;
应用领域&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Analytics]] 分析&lt;br /&gt;
&lt;br /&gt;
* [[Behavior informatics]]  行为信息学&lt;br /&gt;
&lt;br /&gt;
* [[Big Data|Big data]]  大数据&lt;br /&gt;
&lt;br /&gt;
* [[Bioinformatics]]  生物信息学&lt;br /&gt;
&lt;br /&gt;
* [[Business intelligence]]  商务智能&lt;br /&gt;
&lt;br /&gt;
* [[Data analysis]]  数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Data warehouse]]  数据仓库&lt;br /&gt;
&lt;br /&gt;
* [[Decision support system]]  决策支持系统&lt;br /&gt;
&lt;br /&gt;
* [[Domain driven data mining]]  域驱动的数据挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Drug discovery]]  药物发现&lt;br /&gt;
&lt;br /&gt;
* [[Exploratory data analysis]]  探索性数据分析&lt;br /&gt;
&lt;br /&gt;
* [[Predictive analytics]]  预测分析&lt;br /&gt;
&lt;br /&gt;
* [[Web mining]]  网页挖掘&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Application examples&lt;br /&gt;
&lt;br /&gt;
应用示例&lt;br /&gt;
&lt;br /&gt;
{{Main|Examples of data mining}}&lt;br /&gt;
&lt;br /&gt;
{{Category see also|Applied data mining}}&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|=&lt;br /&gt;
&lt;br /&gt;
*[[Automatic number plate recognition in the United Kingdom#Data mining|Automatic number plate recognition in the United Kingdom]]  英国的自动车牌识别&lt;br /&gt;
&lt;br /&gt;
*[[Customer analytics#Data mining|Customer analytics]]  客户分析&lt;br /&gt;
&lt;br /&gt;
*[[Educational data mining]]  教育数据挖掘&lt;br /&gt;
&lt;br /&gt;
*[[National Security Agency#Transaction data mining|National Security Agency]]  国家安全局&lt;br /&gt;
&lt;br /&gt;
*[[Quantitative structure–activity relationship#Data mining approach|Quantitative structure–activity relationship]]  数量结构-活动关系&lt;br /&gt;
&lt;br /&gt;
*[[Surveillance#Data mining and profiling|Surveillance]] / [[Mass surveillance#Data mining|Mass surveillance]] (e.g., [[Stellar Wind (code name)|Stellar Wind]])&lt;br /&gt;
监控/大规模监测（例如，恒星风）&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
; Related topics&lt;br /&gt;
&lt;br /&gt;
相关话题&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to ''analyzing'' data) , see:&lt;br /&gt;
&lt;br /&gt;
For more information about extracting information out of data (as opposed to analyzing data) , see:&lt;br /&gt;
&lt;br /&gt;
有关从数据中提取信息(与分析数据相反)的详细信息，请参阅:&lt;br /&gt;
&lt;br /&gt;
{{columns-list|colwidth=22em|&lt;br /&gt;
&lt;br /&gt;
* [[Data integration]]  数据集成&lt;br /&gt;
&lt;br /&gt;
* [[Data transformation]]  数据转换&lt;br /&gt;
&lt;br /&gt;
* [[Electronic discovery]]  电子发现&lt;br /&gt;
&lt;br /&gt;
* [[Information extraction]]  信息提取&lt;br /&gt;
&lt;br /&gt;
* [[Information integration]]  信息集成&lt;br /&gt;
&lt;br /&gt;
* [[Named-entity recognition]]  命名实体识别&lt;br /&gt;
&lt;br /&gt;
* [[Profiling (information science)]]  分析（信息科学）&lt;br /&gt;
&lt;br /&gt;
* [[Psychometrics]]  心理测量学&lt;br /&gt;
&lt;br /&gt;
* [[Social media mining]]  社交媒体挖掘&lt;br /&gt;
&lt;br /&gt;
* [[Surveillance capitalism]]  资本监视&lt;br /&gt;
&lt;br /&gt;
* [[Web scraping]]  网页抓取&lt;br /&gt;
&lt;br /&gt;
}}&lt;br /&gt;
&lt;br /&gt;
;Other resources&lt;br /&gt;
&lt;br /&gt;
Other resources&lt;br /&gt;
&lt;br /&gt;
其他资源&lt;br /&gt;
&lt;br /&gt;
*[[International Journal of Data Warehousing and Mining]]  国际数据仓库与挖掘杂志&lt;br /&gt;
&lt;br /&gt;
==参考文献 References==&lt;br /&gt;
&lt;br /&gt;
{{Reflist|30em}}&lt;br /&gt;
&lt;br /&gt;
==进一步阅读 Further reading==&lt;br /&gt;
&lt;br /&gt;
{{div col|colwidth=30em}}&lt;br /&gt;
&lt;br /&gt;
* Cabena, Peter; Hadjnian, Pablo; Stadler, Rolf; Verhees, Jaap; Zanasi, Alessandro (1997); ''Discovering Data Mining: From Concept to Implementation'', [[Prentice Hall]], {{ISBN|0-13-743980-6}}&lt;br /&gt;
&lt;br /&gt;
* M.S. Chen, J. Han, [[Philip S. Yu|P.S. Yu]] (1996) &amp;quot;[http://cs.nju.edu.cn/zhouzh/zhouzh.files/course/dm/reading/reading01/chen_tkde96.pdf Data mining: an overview from a database perspective]&amp;quot;. ''Knowledge and data Engineering, IEEE Transactions'' on 8 (6), 866–883&lt;br /&gt;
&lt;br /&gt;
* Feldman, Ronen; Sanger, James (2007); ''The Text Mining Handbook'', [[Cambridge University Press]], {{ISBN|978-0-521-83657-9}}&lt;br /&gt;
&lt;br /&gt;
* Guo, Yike; and Grossman, Robert (editors) (1999); ''High Performance Data Mining: Scaling Algorithms, Applications and Systems'', [[Kluwer Academic Publishers]]&lt;br /&gt;
&lt;br /&gt;
* [[Jiawei Han|Han, Jiawei]], Micheline Kamber, and Jian Pei. ''Data mining: concepts and techniques''. Morgan kaufmann, 2006.&lt;br /&gt;
&lt;br /&gt;
* [[Trevor Hastie|Hastie, Trevor]], [[Robert Tibshirani|Tibshirani, Robert]] and [[Jerome H. Friedman|Friedman, Jerome]] (2001); ''The Elements of Statistical Learning: Data Mining, Inference, and Prediction'', Springer, {{ISBN|0-387-95284-5}}&lt;br /&gt;
&lt;br /&gt;
* [[Bing Liu (computer scientist)|Liu, Bing]] (2007, 2011); ''Web Data Mining: Exploring Hyperlinks, Contents and Usage Data'', [[Springer Verlag|Springer]], {{ISBN|3-540-37881-2}}&lt;br /&gt;
&lt;br /&gt;
* {{cite journal |last=Murphy |first=Chris |date=16 May 2011 |title=Is Data Mining Free Speech? |journal=[[InformationWeek]] |page=12 }}&lt;br /&gt;
&lt;br /&gt;
* Nisbet, Robert; Elder, John; Miner, Gary (2009); ''Handbook of Statistical Analysis &amp;amp; Data Mining Applications'', [[Academic Press]]/Elsevier, {{ISBN|978-0-12-374765-5}}&lt;br /&gt;
&lt;br /&gt;
* Poncelet, Pascal; Masseglia, Florent; and Teisseire, Maguelonne (editors) (October 2007); &amp;quot;Data Mining Patterns: New Methods and Applications&amp;quot;, ''Information Science Reference'', {{ISBN|978-1-59904-162-9}}&lt;br /&gt;
&lt;br /&gt;
* Tan, Pang-Ning; Steinbach, Michael; and Kumar, Vipin (2005); ''Introduction to Data Mining'', {{ISBN|0-321-32136-7}}&lt;br /&gt;
&lt;br /&gt;
* Theodoridis, Sergios; and Koutroumbas, Konstantinos (2009); ''Pattern Recognition'', 4th Edition, Academic Press, {{ISBN|978-1-59749-272-0}}&lt;br /&gt;
&lt;br /&gt;
* Weiss, Sholom M.; and Indurkhya, Nitin (1998); ''Predictive Data Mining'', [[Morgan Kaufmann]]&lt;br /&gt;
&lt;br /&gt;
* {{cite book |author1=Witten, Ian H.|authorlink1=Ian H. Witten |author2=Frank, Eibe |author3=Hall, Mark A. |title=Data Mining: Practical Machine Learning Tools and Techniques |edition=3 |date=30 January 2011 |publisher=Elsevier |isbn=978-0-12-374856-0 }} (See also [[Weka (machine learning)|Free Weka software]])&lt;br /&gt;
&lt;br /&gt;
* Ye, Nong (2003); ''The Handbook of Data Mining'', Mahwah, NJ: Lawrence Erlbaum&lt;br /&gt;
&lt;br /&gt;
{{div col end}}&lt;br /&gt;
&lt;br /&gt;
==相关链接External links==&lt;br /&gt;
&lt;br /&gt;
{{Commons category|Data mining}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Reference/Knowledge_Management/Knowledge_Discovery/Software|Knowledge Discovery Software}}&lt;br /&gt;
&lt;br /&gt;
* {{DMOZ|Computers/Software/Databases/Data_Mining/Tool_Vendors|Data Mining Tool Vendors}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{data}}&lt;br /&gt;
&lt;br /&gt;
{{Data warehouse}}&lt;br /&gt;
&lt;br /&gt;
{{Computer science}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{Authority control}}&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
{{DEFAULTSORT:Data Mining}}&lt;br /&gt;
&lt;br /&gt;
[[Category:Data mining| ]]&lt;br /&gt;
&lt;br /&gt;
[[Category:Formal sciences]]&lt;br /&gt;
&lt;br /&gt;
Category:Formal sciences&lt;br /&gt;
&lt;br /&gt;
类别: 正规科学&lt;br /&gt;
&lt;br /&gt;
&amp;lt;noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
&amp;lt;small&amp;gt;This page was moved from [[wikipedia:en:Data mining]]. Its edit history can be viewed at [[数据挖掘/edithistory]]&amp;lt;/small&amp;gt;&amp;lt;/noinclude&amp;gt;&lt;br /&gt;
&lt;br /&gt;
[[Category:待整理页面]]&lt;/div&gt;</summary>
		<author><name>Zengsihang</name></author>
	</entry>
</feed>