自动机器学习

来自集智百科 - 复杂系统|人工智能|复杂科学|复杂网络|自组织
和光同尘讨论 | 贡献2020年12月4日 (五) 22:47的版本
跳到导航 跳到搜索

此词条暂由Yuling翻译,未经人工整理和审校,带来阅读不便,请见谅。

模板:Multiple issues


模板:Machine learning bar


Automated machine learning (AutoML) is the process of automating the process of applying machine learning to real-world problems. AutoML covers the complete pipeline from the raw dataset to the deployable machine learning model. AutoML was proposed as an artificial intelligence-based solution to the ever-growing challenge of applying machine learning.[1][2] The high degree of automation in AutoML allows non-experts to make use of machine learning models and techniques without requiring to become an expert in this field first.

Automated machine learning (AutoML) is the process of automating the process of applying machine learning to real-world problems. AutoML covers the complete pipeline from the raw dataset to the deployable machine learning model. AutoML was proposed as an artificial intelligence-based solution to the ever-growing challenge of applying machine learning. The high degree of automation in AutoML allows non-experts to make use of machine learning models and techniques without requiring to become an expert in this field first.

自动机器学习 Automated machine learning,AutoML是指实现机器学习自动应用于实际问题的过程。自动机器学习涵盖了从原始数据集到可部署机器学习模型的整个流程。作为一种基于人工智能的解决方案,自动机器学习被用于应对机器学习方面日益增长的挑战[1][2]。自动机器学习中高度的自动化允许非专业人员在无需成为该领域专家的前提下使用机器学习的模型和技术。


Automating the process of applying machine learning end-to-end additionally offers the advantages of producing simpler solutions, faster creation of those solutions, and models that often outperform hand-designed models.

Automating the process of applying machine learning end-to-end additionally offers the advantages of producing simpler solutions, faster creation of those solutions, and models that often outperform hand-designed models.

在机器学习的应用中,将端到端的过程自动化可以产生更多优势:生成更简单的解决方案、更快地创建这些解决方案,并且经常能设计出优于人工设计的模型。


Comparison to the standard machine learning approach

与常规机器学习方法的比较

In a typical machine learning application, practitioners have a dataset consisting of input data points to train on. The raw data itself may not be in a form such that all algorithms may be applicable to it out of the box. An expert may have to apply appropriate data pre-processing, feature engineering, feature extraction, and feature selection methods that make the dataset amenable for machine learning. Following those preprocessing steps, practitioners must then perform algorithm selection and hyperparameter optimization to maximize the predictive performance of their machine learning model. Clearly all of those steps induce their own challenges, accumulating to a significant hurdle to get started with machine learning.

In a typical machine learning application, practitioners have a dataset consisting of input data points to train on. The raw data itself may not be in a form such that all algorithms may be applicable to it out of the box. An expert may have to apply appropriate data pre-processing, feature engineering, feature extraction, and feature selection methods that make the dataset amenable for machine learning. Following those preprocessing steps, practitioners must then perform algorithm selection and hyperparameter optimization to maximize the predictive performance of their machine learning model. Clearly all of those steps induce their own challenges, accumulating to a significant hurdle to get started with machine learning.

在一个典型的机器学习应用程序中,程序的使用者会使用一个由输入数据点组成的数据集去进行训练。原始数据本身的形式可能并不适用于所有算法。专家可能需要使用相应的数据预处理 data pre-processing 特征工程 feature engineering特征提取 feature extraction特征选择方法 feature selectin methods等方法,使数据集适合机器学习。按照这些预处理步骤,程序的使用者必须执行算法选择 algorithm 超参数优化 hyperparameter optimization,以最大限度地提升他们的机器学习模型的预测性能。显然,这些步骤都为它们自身带来了挑战。这些挑战一旦累积到一定程度,就会成为机器学习的重大障碍。


A downside are the additional parameters of AutoML tools, which may need some expertise to be set themselves. Although those hyperparameters exist, AutoML simplifies the application of machine learning for non-experts dramatically.

A downside are the additional parameters of AutoML tools, which may need some expertise to be set themselves. Although those hyperparameters exist, AutoML simplifies the application of machine learning for non-experts dramatically.

自动机器学习这一工具的不足之处就是对附加参数的依赖。这些参数可能需要一些专业知识才能得出。尽管有这些超参数存在,自动机器学习依旧极大地简化了非专业性机器学习的应用。


Targets of automation

自动机器学习的目标

Automated machine learning can target various stages of the machine learning process.[2] Essentially the targets can be grouped into the fields data preparation, feature engineering, model selection, selection of evaluation metrics, and hyperparameter optimization.

Automated machine learning can target various stages of the machine learning process. Essentially the targets can be grouped into the fields data preparation, feature engineering, model selection, selection of evaluation metrics, and hyperparameter optimization.

自动机器学习可以针对机器学习过程的不同阶段[2]。从本质上看,这包括数据准备、特征工程、模型选择、评价指标的选择和超参数优化。

  • Automated data preparation and ingestion (from raw data and miscellaneous formats)

自动化数据准备 automated data preparation 数据摄入 ingestion (源于原始数据和混杂模式)

    • Automated column type detection; e.g., boolean, discrete numerical, continuous numerical, or text

自动化数据类型检测,例如:布尔数据,离散数值,连续数值或者文本

    • Automated column intent detection; e.g., target/label, stratification field, numerical feature, categorical text feature, or free text feature

自动化数据意图检测,例如:目标/标签,分层抽样 stratified sampling 数值特征 numerical feature 既定文本特征 categorical text feature以及自由文本特征 free tect feature 等 ==Yuling讨论) categorical text feature, or free text feature 这两个应该是专业词汇,没有查到具体的翻译 ==和光同尘讨论)此处应该可以理解为检测意图包括对已明确类型结构的文本和自由文本两种不同类的文本模式各自特征的检测,因此可翻译为“既定文本特征以及自由文本特征”。

自动化任务检测,例如:二分类 binary classification 回归分析 regression analysis聚类 clustering 排序学习 learing to rank

自动化特征工程

特征选择 feature selection

特征提取 feature extraction

元学习 meta learing 体征转化 transfer learning

    • Detection and handling of skewed data and/or missing values

偏斜数据 skewed data和缺失值的检测和处理

自动化模型选择

特征工程 featurization学习算法 learning algorithm 中的超参数优化

  • Automated pipeline selection under time, memory, and complexity constraints

在时间,内存和复杂性约束下的自动化流水线式选择

  • Automated selection of evaluation metrics / validation procedures

自动化选择评估指标/验证程序

  • Automated problem checking

自动化问题检测

    • Leakage detection

数据泄露检测

    • Misconfiguration detection

配置错误检测

  • Automated analysis of results obtained

自动分析获得的结果

  • User interfaces and visualizations for automated machine learning

用于自动化机器学习的用户界面及可视性


See also

神经架构 neural architecture 搜索

超参数优化

模型选择 model seletion

神经进化 neuroevolution

自优化 self-tuning


References

  1. 1.0 1.1 Thornton C, Hutter F, Hoos HH, Leyton-Brown K (2013). Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms. KDD '13 Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. pp. 847–855.
  2. 2.0 2.1 2.2 2.3 Hutter F, Caruana R, Bardenet R, Bilenko M, Guyon I, Kegl B, and Larochelle H. "AutoML 2014 @ ICML". AutoML 2014 Workshop @ ICML. Retrieved 2018-03-28.

Category:Machine learning

分类: 机器学习

Category:Artificial intelligence

类别: 人工智能


This page was moved from wikipedia:en:Automated machine learning. Its edit history can be viewed at 自动机器学习/edithistory