<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Energy Res.</journal-id>
<journal-title>Frontiers in Energy Research</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Energy Res.</abbrev-journal-title>
<issn pub-type="epub">2296-598X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">756733</article-id>
<article-id pub-id-type="doi">10.3389/fenrg.2021.756733</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Energy Research</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Heuristic Feature Selection for Wind Power Anomaly Events Study</article-title>
<alt-title alt-title-type="left-running-head">Yu and Lin</alt-title>
<alt-title alt-title-type="right-running-head">WInd Power Anomaly Study</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Yu</surname>
<given-names>Peiwen</given-names>
</name>
<xref ref-type="aff" rid="aff1">
<sup>1</sup>
</xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Lin</surname>
<given-names>Anping</given-names>
</name>
<xref ref-type="aff" rid="aff2">
<sup>2</sup>
</xref>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/1430481/overview"/>
</contrib>
</contrib-group>
<aff id="aff1">
<label>
<sup>1</sup>
</label>Maritime College, Guangdong Ocean University, <addr-line>Zhanjiang</addr-line>, <country>China</country>
</aff>
<aff id="aff2">
<label>
<sup>2</sup>
</label>School of Physics and Electronic Electrical Engineering, Xiangnan University, <addr-line>Chenzhou</addr-line>, <country>China</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1375074/overview">Tinghui Ouyang</ext-link>, National Institute of Advanced Industrial Science and Technology (AIST), Japan</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1378126/overview">Zhenhao Tang</ext-link>, Northeast Electric Power University, China</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/1458844/overview">Huangke Chen</ext-link>, National University of Defense Technology, China</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Anping Lin, <email>anping719@126.com</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Wind Energy, a section of the journal Frontiers in Energy Research</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>01</day>
<month>10</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>9</volume>
<elocation-id>756733</elocation-id>
<history>
<date date-type="received">
<day>11</day>
<month>08</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>14</day>
<month>09</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2021 Yu and Lin.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Yu and Lin</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these&#x20;terms.</p>
</license>
</permissions>
<abstract>
<p>Wind power ramp events are typical harmful anomaly events in wind engineering, which bring new threat to the safety operation of power systems. To in-depth understand ramps and mitigate their harms, suitable ramp characteristics are crucial in many studies, e.g., ramp definition, classification, prediction and so on. However, due to ramps&#x2019; specificity on event feature, more profound characteristics are needed besides basic ramp morphological characteristics. In this paper, an approach for extracting and selecting ramp characteristics is proposed for ramp study. First, according to ramps&#x2019; causation on energy change, wavelet transformation is introduced to analyze ramp categories, and used to extract ramp energy characteristics. Then, heuristic feature selection methods are proposed to select ramp characteristics based on specific ramp application contexts. The objective of feature selection is to remove redundant characteristics, and to improve ramp studies&#x2019; performance. Finally, combining basic ramp characteristics and wavelet characteristics, ramp studies on category classification and prediction of appointed characteristics are implemented on industrial data. The computational results validate the usefulness of wavelet characteristics, the feasibility of the proposed approach, and that performance of ramp study could be improved by using ramp characteristics in this&#x20;paper.</p>
</abstract>
<kwd-group>
<kwd>wind power ramp events</kwd>
<kwd>wavelet transform</kwd>
<kwd>feature selection</kwd>
<kwd>anomaly detection</kwd>
<kwd>feature exaction</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<p>The generation of energy from wind is growing across the world, especially in China where large-scale and highly-concentrated wind projects prevail (<xref ref-type="bibr" rid="B19">Ouyang et&#x20;al., 2017a</xref>). Due to the renewability feature, wind energy offered lots of opportunities, e.g., proving clean energy and reducing environment pollution. On the other hand, due to wind&#x2019;s fluctuation and intermittent, serious anomaly challenges threaten the safety and stability of power grid. For example, wind power ramp events are typical anomaly events bringing one of the greatest threat, which is namely the large and unexpected changes of wind power over a short time period (<xref ref-type="bibr" rid="B27">Wang et&#x20;al., 2017</xref>). In 2008, a down-ramp event was reported in the State of Texas causing serious economic loss to the grid operated by Electric Reliability Council of Texas (ERCOT) (<xref ref-type="bibr" rid="B9">Francis, 2008</xref>). Therefore, it is significantly important to study ramp events for mitigating their negative impacts.</p>
<p>Ramp study mainly involves definitions, detection, prediction and classification. Generally, ramp definition and ramp detection are the basis of ramp study. While ramp events are usually detected by combining ramp definitions and specific detection methods. For example, dynamic programming recursion and the swinging door algorithm were proposed to detect ramp events from wind power data in (<xref ref-type="bibr" rid="B8">Florita et&#x20;al., 2013</xref>; <xref ref-type="bibr" rid="B22">Sevlian and Rajagopal, 2013</xref>; <xref ref-type="bibr" rid="B21">Ouyang et&#x20;al., 2017b</xref>). In (<xref ref-type="bibr" rid="B29">Xiong et&#x20;al., 2017</xref>), a data mining method using affinity of weather data was also proposed for ramp detection. However, the mainstream definitions up to now mainly focus on three characteristics (<xref ref-type="bibr" rid="B30">Zha et&#x20;al., 2016</xref>) (e.g., ramp amplitude, ramp duration, and ramp rate) which are superficial characteristics from ramp events&#x2019; basic forms. Copying with complex power system operations in the future, more targeted and effective control strategies need to be made, which are essentially based on study of more profound ramp characteristics. On the other hand, ramp prediction and classification are two major objectives of ramp study. Generally, ramp prediction can be divided into event prediction and ramp&#x2019;s categories prediction which is actually ramp classification. Nowadays, ramp classification has been studied via many data mining algorithms, e.g., <italic>k-means</italic>, support vector machine (SVM), extrema learning machine (ELM), neural networks (NN) and so on (<xref ref-type="bibr" rid="B5">Couto et&#x20;al., 2013</xref>; <xref ref-type="bibr" rid="B8">Florita et&#x20;al., 2013</xref>; <xref ref-type="bibr" rid="B26">Tang et&#x20;al., 2020</xref>; <xref ref-type="bibr" rid="B23">Shen et&#x20;al., 2021</xref>). Ramp classification combined with weather regimes was also studied in (<xref ref-type="bibr" rid="B3">Chen et&#x20;al., 2018</xref>). No matter ramp prediction or classification, proper input features are the premise of constructing high-performance models. However, most of these studies are based on superficial characteristics, no profound physical characteristics are considered to improve ramp studies&#x2019; performance. Therefore, it is significant useful for studying extraction and selection of ramp characteristics in wind power ramp researches.</p>
<p>In modeling process, determination of input features is primarily based on original data points. Sometimes feature extraction, selection and transformation are involved according to specific criterions. For example, principal component analysis (PCA) is a commonly-used method to reduce dimension of feature space, which was also used in feature analysis for wind forecasting (<xref ref-type="bibr" rid="B14">He et&#x20;al., 2013a</xref>). Other methods based on mathematical transforms were also useful to extract characteristics, e.g. wavelet-transform was utilized in wind power forecasting (<xref ref-type="bibr" rid="B24">Singh and Tewari, 2015</xref>). Moreover, Pearson correlation coefficient, Gini index, wavelet transformation and other intelligent tools were also applied to feature processing in engineering (<xref ref-type="bibr" rid="B16">Huang et&#x20;al., 2018</xref>). Nowadays, with more industrial signals are collected from complicated systems and more un-researchable objects are analyzed, these situations lead to the urgent requirement of profound characteristics reflecting structural or physical features in modeling. Study on wind power ramp events is a representative problem among these issues. According to ramps&#x2019; concept, ramp events involve a period of wind power values and variance, and they don&#x2019;t always have a unified time duration (<xref ref-type="bibr" rid="B25">Tang et&#x20;al., 2021</xref>). Based on the traditional tools, basic characteristics (e.g., ramp amplitude, duration and ramp rate) could be obtained from wind power data. However, ramps&#x2019; harmful effect on power grid is not just identified by ramp duration and amplitude. The difference of ramp amplitude, ramp rate, energy storage and other factors may also affect the stability of power system at different degree. Therefore, besides the basic ramp characteristics, how to acquire more profound characteristics is an urgent topic in ramp study, such as in ramp classification and prediction.</p>
<p>According to the outlined problems above, the objective of this paper is to propose an approach to extract and select ramp characteristics for wind power ramp study. Considering ramp events involves the variance of time series and energy change process of wind power, three basic ramp characteristics are extracted based on definitions firstly. These characteristics are able to distinguish ramps and non-ramp events. Then, a method transforming time series into energy forms is proposed to extract extra characteristics. Wavelet transformation has been applied for feature expression in literatures due to its superior description ability at both time and frequency domains. For example, the wavelet transform was utilized to analyze the features of ramp events in (<xref ref-type="bibr" rid="B10">Gallego et&#x20;al., 2013</xref>). On the other hand, wavelet decomposition has the property of multiresolution which is helpful to study the allocation of ramp event&#x2019;s energy. Summarizing these two properties, wavelet transformation is proposed to extract profound characteristics for distinguishing refined ramp categories in depth. Moreover, for reducing dimension, mitigating noise&#x2019;s influence, improving computation efficiency, a heuristic intelligent algorithm is proposed in the feature selection. Finally, based on the refined characteristic vector, ramp studies (classification, prediction) on industrial datasets are discussed, and validate the approach in extracting and selecting ramp characteristics. The framework of the major work in this paper is sketched in the following figure.</p>
<p>In <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>, the identification of historical ramp events is implemented through ramp definitions and detection. Class labels of ramp events are determined by a given classification environment which could be based on weather sceneries, control requirement and so on. The other characteristics are energy characteristics extracted by wavelet transformation in this paper, and <italic>f</italic>
<sub>
<italic>n</italic>
</sub> represents the <italic>nth</italic> characteristic in the formed characteristic vector in <xref ref-type="fig" rid="F1">Figure&#x20;1</xref>. According to the above description, we can conclude the novelties of this paper as following three points:<list list-type="simple">
<list-item>
<p>
<italic>i</italic>) This paper proposes to consider characteristics of ramp events from multiple aspects, including the basic morphological characteristics from time domain and characteristics in frequency domain. Moreover, due to ramp events&#x2019; specificity, characteristics are also extracted in terms of energy. This is the first time to consider ramp events&#x2019; energy characteristics.</p>
</list-item>
<list-item>
<p>
<italic>ii</italic>) Wavelet transformation is proposed to extract ramp characteristics. By utilizing the frequency and multiresolution properties in wavelet decomposition, ramp energy characteristics are expressed by energy at different frequency spaces. Meanwhile, these energy characteristics are selected and refined. Its purpose is to delete the energy of noise which may affect ramp classification.</p>
</list-item>
<list-item>
<p>
<italic>iii</italic>) Heuristic intelligent algorithms are tried in the selection process, e.g., the sequential forward floating search (SFFS) and sequential backward floating search (SBFS) methods. The heuristic feature selection could refine the characteristic vector in related studies more effectively than unsupervised methods reducing dimension.</p>
</list-item>
</list>
</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Framework of the study in this paper.</p>
</caption>
<graphic xlink:href="fenrg-09-756733-g001.tif"/>
</fig>
<p>Besides the above introduction, rest of this paper is organized as follows. <italic>Feature Extraction</italic> addresses the processes of extracting ramp characteristics, including the basic ramp characteristics based on ramp definitions, and ramp energy characteristics based on wavelet transformation, for ramp studies are also extracted. <italic>Feature Selection</italic> proposes the feature selection approach which is based on dispersion matrix and heuristic method. The detailed processes are also presented in this section. <italic>Ramp Anomaly Analysis and Evaluation</italic> aims at designing ramp studies, e.g., ramp classification and ramp prediction. It also gives out some indicators for evaluating ramp study. In <italic>Experiments and Discussion</italic>, industrial wind power data is utilized in case study. Performance on ramp classification and prediction are compared with models using different feature sets and that using PCA for feature selection. Computational results validate the feasibility of wavelet characteristics and the proposed feature selection method. Finally, <italic>Conclusion</italic> concludes this&#x20;paper.</p>
</sec>
<sec id="s2">
<title>Feature Extraction</title>
<sec id="s2-1">
<title>Basic Characteristics of Ramp Events</title>
<p>Wind power ramp events bring great harm to system operation as more and more wind power integrated into power grid. Copying with these new events, a series of studies has been carried out, such as ramp definition, ramp prediction and classification. Currently, there are four mainstream definitions widely used in ramp analysis (<xref ref-type="bibr" rid="B30">Zha et&#x20;al., 2016</xref>). These definitions are defined as follows.</p>
<p>
<statement content-type="definition" id="Definition_1">
<label>Definition 1</label>
<p>When the change of wind power in time duration <italic>&#x2206;t</italic> exceeds a given threshold <italic>Wp</italic>
<sub>
<italic>val</italic>
</sub>, there is a ramp event occurring, as expressed as below.<disp-formula id="e1">
<mml:math id="m1">
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>&#x394;</mml:mi>
<mml:mi>t</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>W</mml:mi>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
<mml:mo>&#x2265;</mml:mo>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
<label>(1)</label>
</disp-formula>where: <italic>Wp</italic>(<italic>t&#x2b;&#x2206;t</italic>) and <italic>Wp</italic>(<italic>t</italic>) are wind power values at time <italic>t&#x2b;&#x2206;t</italic> and <italic>t</italic>, respectively; <italic>Wp</italic>
<sub>
<italic>val</italic>
</sub> represents the threshold of ramp amplitude. When the criterion in <xref ref-type="disp-formula" rid="e1">Eq. 1</xref> meets under a given time period, a ramp event is identified.</p>
</statement>
</p>
<p>
<statement content-type="definition" id="Definition_2">
<label>Definition 2</label>
<p>When the largest difference of wind power in time duration <italic>&#x2206;t</italic> exceeds the given threshold <italic>Wp</italic>
<sub>
<italic>val</italic>
</sub>, then a ramp event is regarded as occurring.<disp-formula id="e2">
<mml:math id="m2">
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:munder>
<mml:mrow>
<mml:mi>max</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>&#x394;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:munder>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:munder>
<mml:mrow>
<mml:mi>min</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>&#x394;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:munder>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
<mml:mo>&#x2265;</mml:mo>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
<label>(2)</label>
</disp-formula>where, <inline-formula id="inf1">
<mml:math id="m3">
<mml:mrow>
<mml:munder>
<mml:mrow>
<mml:mi>max</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>&#x394;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:munder>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula> and <inline-formula id="inf2">
<mml:math id="m4">
<mml:mrow>
<mml:munder>
<mml:mrow>
<mml:mi>min</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>&#x394;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:munder>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mi>i</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>represent the maximum and minimum value of wind power in a time duration <italic>&#x2206;t.</italic>
</p>
</statement>
</p>
<p>
<statement content-type="definition" id="Definition_3">
<label>Definition 3</label>
<p>When the average change of wind power in a given time duration <italic>&#x2206;t</italic> exceeds the given threshold <italic>Wp</italic>
<sub>
<italic>val</italic>
</sub>, a ramp event is identified.<disp-formula id="e3">
<mml:math id="m5">
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>i</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>h</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>&#x394;</mml:mi>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>i</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>W</mml:mi>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>i</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mi>h</mml:mi>
</mml:mrow>
<mml:mo>&#x2265;</mml:mo>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
<label>(3)</label>
</disp-formula>where, <italic>h</italic> is the time horizon in ramp identification.</p>
</statement>
</p>
<p>
<statement content-type="definition" id="Definition_4">
<label>Definition 4</label>
<p>When the ratio between the wind power change &#x7c;<italic>Wp</italic>(<italic>t</italic>&#x2b;<italic>&#x2206;t</italic>)-<italic>Wp</italic>(<italic>t</italic>)&#x7c; and time duration <italic>&#x2206;t</italic> exceeds a given threshold <italic>R</italic>
<sub>
<italic>val</italic>
</sub>, then a ramp event is regarded as occurring.<disp-formula id="e4">
<mml:math id="m6">
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>&#x394;</mml:mi>
<mml:mi>t</mml:mi>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>W</mml:mi>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mrow>
<mml:mi>&#x394;</mml:mi>
<mml:mi>t</mml:mi>
</mml:mrow>
</mml:mrow>
<mml:mo>&#x3e;</mml:mo>
<mml:msub>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:math>
<label>(4)</label>
</disp-formula>where, this definition in <xref ref-type="disp-formula" rid="e4">Eq. 4</xref> pays more attention on ramp rate while that in <xref ref-type="disp-formula" rid="e1">Eq. 1</xref> emphasizes only ramp amplitude. Summarizing the above four definitions, we can see they mainly focus on three major characteristics (<xref ref-type="bibr" rid="B30">Zha et&#x20;al., 2016</xref>), such as ramp amplitude <italic>Var</italic>, ramp duration <italic>T</italic>, and ramp rate <italic>R</italic>. Based on these three characteristics, the variance of wind power in a given period could be determined as ramps or non-ramps. Therefore, they consist of the initial characteristic vector in ramp study, as <italic>C</italic>
<sub>
<italic>v0</italic>
</sub> &#x3d; [<italic>Var, T, R</italic>]. As we know, sometimes ramp direction is also used in characteristic analysis. However, through above numerical definitions, ramp direction is not necessary, and could be expressed by sign of <italic>R</italic> when needed. Considering that ramp analysis in some cases needs the detailed information about power range rather than only fluctuation amplitude, so we replace ramp amplitude <italic>Var</italic> with maximum and minimum values. Assuming there are <italic>N</italic> studied ramp events in dataset, the initial characteristic matrix <bold>
<italic>X</italic>
</bold>
<sub>0</sub> is expressed as below.<disp-formula id="e5">
<mml:math id="m7">
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">X</mml:mi>
<mml:mn>0</mml:mn>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>max</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>min</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>T</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>R</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mn>2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>max</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mn>2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>min</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>T</mml:mi>
<mml:mn>2</mml:mn>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>R</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mo>&#x22ee;</mml:mo>
</mml:mtd>
<mml:mtd>
<mml:mo>&#x22ee;</mml:mo>
</mml:mtd>
<mml:mtd>
<mml:mo>&#x22ee;</mml:mo>
</mml:mtd>
<mml:mtd>
<mml:mo>&#x22ee;</mml:mo>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>max</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>min</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>T</mml:mi>
<mml:mi>N</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi>R</mml:mi>
<mml:mi>N</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>]</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(5)</label>
</disp-formula>where, <italic>Wp</italic>
<sub>
<italic>i,</italic>min</sub> and <italic>Wp</italic>
<sub>
<italic>i,</italic>max</sub> represent the minimum and maximum value of wind power in the <italic>ith</italic> studied ramp&#x20;event.</p>
</statement>
</p>
</sec>
<sec id="s2-2">
<title>Wavelet Transformation and Characteristics Extraction</title>
<p>As the research on ramp events get more in depth, profound characteristics are needed to describe ramps&#x2019; formation and categories. For example, the initial characteristics in <xref ref-type="disp-formula" rid="e4">Eq. 4</xref> is used to identify the basic formation of ramps and non-ramps. The detailed fluctuation inside ramps needs structural characteristics, and the essence of ramps&#x2019; occurrence involves energy characteristics. In order to extract more profound information in ramp study, wavelet transformation is applied in this paper. Wavelet transformation is an advanced mathematical technique in signal analysis (<xref ref-type="bibr" rid="B17">Mohanty et&#x20;al., 2015</xref>). It has advantages at decomposing a signal into various time and frequency domains, so it is useful to study the structural characteristics of ramps in different domains. Wavelet transformation also has advantages at detecting abrupt changed values (e.g., in edge detection) and analyzing signal in a specific time window. While ramp events certainly have large power charge in finite time durations, so it is relatively suitable to utilize wavelet transformation in ramp analysis (<xref ref-type="bibr" rid="B7">Escalante Soberanis and M&#xe9;rida, 2015</xref>). On the other hand, due to the multiresolution feature of wavelet decomposition, energy of a given signal could be allocated into different frequency spaces. In this way, we are inspired to extract characteristics for expressing ramps&#x2019; energy characteristics. This is also a key reason for considering wavelet transformation in extracting ramp characteristics.</p>
<p>The theory of discrete wavelet transformation is described as below. Assuming a discrete signal (e.g., wind power time series of a ramp event) is expressed as {<italic>x</italic>(<italic>t</italic>); <italic>t</italic>&#x20;&#x3d; 1,2, &#x22ef;, <italic>T</italic>}, it could be reconstructed by elements of wavelet transformation, as expressed below.<disp-formula id="e6">
<mml:math id="m8">
<mml:mrow>
<mml:mi>x</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="bold">Z</mml:mi>
</mml:mrow>
</mml:munder>
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>&#x2208;</mml:mo>
<mml:mi mathvariant="bold">Z</mml:mi>
</mml:mrow>
</mml:munder>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3b4;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x22c5;</mml:mo>
<mml:msub>
<mml:mi>&#x3c8;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
<label>(6)</label>
</disp-formula>where: <italic>x</italic>(<italic>t</italic>) is actually the signal of wind power; <italic>&#x3b4;</italic>
<sub>
<italic>j,k</italic>
</sub> is the wavelet coefficient; <italic>&#x3c8;</italic>
<sub>
<italic>j,k</italic>
</sub> is the child wavelet transformed from mother wavelet, denoted as follows.<disp-formula id="e7">
<mml:math id="m9">
<mml:mrow>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:msub>
<mml:mi>&#x3c8;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:msup>
<mml:mi>a</mml:mi>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>j</mml:mi>
<mml:mo>/</mml:mo>
<mml:mn>2</mml:mn>
</mml:mrow>
</mml:msup>
<mml:mi>&#x3c8;</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:msup>
<mml:mi>a</mml:mi>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>j</mml:mi>
</mml:mrow>
</mml:msup>
<mml:mo>&#x22c5;</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>k</mml:mi>
<mml:mi>b</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:msub>
<mml:mi>&#x3b4;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>&#x221e;</mml:mi>
</mml:mrow>
<mml:mi>&#x221e;</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3c8;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x22c5;</mml:mo>
<mml:mi>x</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mi>a</mml:mi>
<mml:mo>&#x3e;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>b</mml:mi>
<mml:mo>&#x3e;</mml:mo>
<mml:mn>0</mml:mn>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(7)</label>
</disp-formula>where: <italic>j</italic> and <italic>k</italic> represent the scale and shift parameters of child wavelet <italic>&#x3c8;</italic>
<sub>
<italic>j,k</italic>
</sub>; <italic>&#x3c8;</italic>(<italic>t</italic>) is the mother wavelet function; <italic>a</italic> and <italic>b</italic> are real parameters. From <xref ref-type="disp-formula" rid="e6">Eqs 6</xref>, <xref ref-type="disp-formula" rid="e7">7</xref> it implies that the reproduction of original signal could be realized by the weighted sum of wavelet components at different scales.</p>
<p>To in-depth explain the meaning of each wavelet component in <xref ref-type="disp-formula" rid="e6">Eq. 6</xref>, we could operate wavelet decompose step by step. Assuming the original signal with finite energy is projected on a space <bold>L</bold>, <italic>x</italic>(<italic>t</italic>) with one-level-decomposition could be expressed as below.<disp-formula id="e8">
<mml:math id="m10">
<mml:mrow>
<mml:mi>x</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2b;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msub>
<mml:mi>d</mml:mi>
<mml:mi>k</mml:mi>
</mml:msub>
<mml:mo>&#x22c5;</mml:mo>
<mml:msub>
<mml:mi>&#x3c8;</mml:mi>
<mml:mi>k</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>x</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
<label>(8)</label>
</disp-formula>where, <italic>x</italic>
<sub>1</sub>(<italic>t</italic>) is the estimation of the original signal reflecting variation in time domain; <inline-formula id="inf3">
<mml:math id="m11">
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:mi>d</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>k</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x22c5;</mml:mo>
<mml:msub>
<mml:mi>&#x3c8;</mml:mi>
<mml:mi>k</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>x</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
</inline-formula> are detailed signals expressed by wavelet functions which contain frequency-domain information. By estimating the approximate signal iteratively, <italic>x</italic>
<sub>
<italic>j</italic>
</sub>(<italic>t</italic>) at the <italic>jth</italic> decomposition level is expressed as below.<disp-formula id="e9">
<mml:math id="m12">
<mml:mrow>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi>x</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2b;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msub>
<mml:mi>d</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x22c5;</mml:mo>
<mml:msub>
<mml:mi>&#x3c8;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
<label>(9)</label>
</disp-formula>Similarly, we could utilize a series of wavelet functions to describe signal <italic>x</italic>
<sub>
<italic>j</italic>
</sub>(<italic>t</italic>), as <inline-formula id="inf4">
<mml:math id="m13">
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msub>
<mml:mi>c</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mi>&#x3d5;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
</inline-formula>. Combining these formulas, transformation of the original signal in <xref ref-type="disp-formula" rid="e6">Eq. 6</xref> could be rewritten in details as below<disp-formula id="e10">
<mml:math id="m14">
<mml:mrow>
<mml:mi>x</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msub>
<mml:mi>c</mml:mi>
<mml:mrow>
<mml:msub>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mi>&#x3d5;</mml:mi>
<mml:mrow>
<mml:msub>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
<mml:mo>&#x2b;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi>j</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:msub>
</mml:mrow>
</mml:munderover>
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msub>
<mml:mi>d</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:msub>
<mml:mi>&#x3c8;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
<label>(10)</label>
</disp-formula>where, the auxiliary function <italic>&#x3d5;</italic> is called father wavelet; <italic>c</italic>
<sub>
<italic>jn,k</italic>
</sub> is the coefficients of wavelets <inline-formula id="inf5">
<mml:math id="m15">
<mml:mrow>
<mml:msub>
<mml:mi>&#x3d5;</mml:mi>
<mml:mrow>
<mml:msub>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula>; <italic>d</italic>
<sub>
<italic>j,k</italic>
</sub> are the coefficients of wavelets <inline-formula id="inf6">
<mml:math id="m16">
<mml:mrow>
<mml:msub>
<mml:mi>&#x3c8;</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>t</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula>. The formula in <xref ref-type="disp-formula" rid="e10">Eq. 10</xref> is generally called as the multi-resolution analysis of wavelet transformation (<xref ref-type="bibr" rid="B6">Doucoure et&#x20;al., 2016</xref>).</p>
<p>On the other hand, by corresponding each wavelet component to a frequency space, we could also divide the space <bold>L</bold> to series of energy subspaces. As shown in <xref ref-type="fig" rid="F2">Figure&#x20;2</xref>, V<sub>j0</sub> represents the original signal space <bold>L</bold> with a frequency band (0&#x223c;<italic>f</italic>). According to <xref ref-type="disp-formula" rid="e10">Eq. 10</xref>, the frequency band is also divided step by step. For example, V<sub>
<italic>j0</italic>
</sub> could be divided as orthogonal sum of a low-frequency space V<sub>j1</sub> (0&#x223c;<italic>f</italic>/2) and a high-frequency space W<sub>j1</sub> (<italic>f</italic>/2&#x223c;<italic>f</italic>). The relationship reflecting the division of frequency spaces in wavelet transformation is presented as below.<disp-formula id="e11">
<mml:math id="m17">
<mml:mrow>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:msub>
<mml:mi mathvariant="bold">V</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mo>&#x2295;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">V</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mi mathvariant="bold">L</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mi mathvariant="bold">1</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2295;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mi mathvariant="bold">2</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2295;</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>&#x2295;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2295;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">V</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(11)</label>
</disp-formula>where: <inline-formula id="inf7">
<mml:math id="m18">
<mml:mo>&#x2295;</mml:mo>
</mml:math>
</inline-formula> is a denoted operator calculating the orthogonal sum; <italic>n</italic> is the number of wavelet decomposition.</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>The orthogonal decomposition of the space <bold>L</bold>.</p>
</caption>
<graphic xlink:href="fenrg-09-756733-g002.tif"/>
</fig>
<p>Considering signal&#x2019;s energy is generally expressed at frequency subspaces, therefore we could utilize the multi-resolution of wavelet decomposition to analyze the energy distribution of a signal (<xref ref-type="bibr" rid="B1">Ashrafian et&#x20;al., 2017</xref>), as described in the following formula.<disp-formula id="e12">
<mml:math id="m19">
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>P</mml:mi>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mi>x</mml:mi>
<mml:mo>}</mml:mo>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>c</mml:mi>
<mml:mrow>
<mml:msub>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:mstyle>
<mml:mo>&#x2b;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>j</mml:mi>
</mml:munder>
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>d</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
<label>(12)</label>
</disp-formula>where: &#x7c;P<sub>{<italic>x</italic>}</sub>&#x7c;<sup>2</sup> represent the energy of the given signal {<italic>x</italic>(<italic>t</italic>)}; <inline-formula id="inf8">
<mml:math id="m20">
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>c</mml:mi>
<mml:mrow>
<mml:msub>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
</inline-formula> and <inline-formula id="inf9">
<mml:math id="m21">
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>d</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:math>
</inline-formula> represent the energy of different subspaces. Since wind process generally involved atmosphere movements (<xref ref-type="bibr" rid="B17">Mohanty et&#x20;al., 2015</xref>), the occurrence of ramp events could be comprehensibly regarded as the speedy energy release or accumulation in atmosphere systems. Therefore, the energy expressions based on wavelet transform could be utilized to extract ramp energy characteristics which is meaningful in studying ramp&#x2019;s harms on power systems.</p>
<p>Moreover, when the number of decomposition levels is high (e.g., <italic>j</italic>
<sub>
<italic>n</italic>
</sub>
<italic>&#x2192;</italic>&#x221e;), the value of <italic>c</italic>
<sub>
<italic>jn,k</italic>
</sub> is small, which implies the energy of V<sub>
<italic>jn</italic>
</sub> becoming small to be ignored. In that case, the energy characteristics of W<sub>
<italic>j</italic>
</sub> are mainly selected into the characteristic vector for ramp study in this paper.<disp-formula id="e13">
<mml:math id="m22">
<mml:mrow>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:msub>
<mml:mi>P</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munder>
<mml:mo>&#x2211;</mml:mo>
<mml:mi>k</mml:mi>
</mml:munder>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>d</mml:mi>
<mml:mrow>
<mml:mi>j</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mo>;</mml:mo>
</mml:mrow>
</mml:mstyle>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:msub>
<mml:mi>C</mml:mi>
<mml:mi>v</mml:mi>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo>[</mml:mo>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mi>max</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>W</mml:mi>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mi>min</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mi>T</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>R</mml:mi>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>P</mml:mi>
<mml:mi>j</mml:mi>
</mml:msub>
<mml:mo>]</mml:mo>
</mml:mrow>
<mml:mo>;</mml:mo>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mi>j</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1,2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>j</mml:mi>
<mml:mi>n</mml:mi>
</mml:msub>
<mml:mo>;</mml:mo>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(13)</label>
</disp-formula>where: <italic>P</italic>
<sub>
<italic>j</italic>
</sub> represents the <italic>jth</italic> energy characteristic and <italic>j</italic> is the decomposition level. <italic>C</italic>
<sub>
<italic>v</italic>
</sub> is the characteristic vector combining initial vector <italic>C</italic>
<sub>
<italic>v0</italic>
</sub> and <italic>P</italic>
<sub>
<italic>j</italic>
</sub>. By utilizing this vector including basic ramp characteristics and wavelet energy characteristics as inputs, some advanced ramp study could be implemented besides the identification of ramps and non-ramps.</p>
</sec>
</sec>
<sec id="s3">
<title>Feature Selection</title>
<p>According to the above wavelet decomposition, <italic>j</italic>
<sub>
<italic>n</italic>
</sub> energy characteristics are extracted. Generally, the more the number of decomposition levels, the better the description ability of wavelet characteristics. In <xref ref-type="disp-formula" rid="e13">Eq. 13</xref>, the energy in frequency space V<sub>
<italic>jn</italic>
</sub> is excluded since V<sub>
<italic>jn</italic>
</sub> is the lowest frequency and its <italic>c</italic>
<sub>
<italic>jn,k</italic>
</sub> is very small. However, when more fine-sorted energy characteristics <italic>P</italic>
<sub>
<italic>j</italic>
</sub> are generated, it is unavoidable to lead to many superfluous characteristics in a specific study case. Therefore, excluding basic ramp characteristics, feature selection is also necessary in ramp&#x20;study.</p>
<p>Feature selection could not only select optimal energy characteristics for specific study, but also improve computing performance by reducing data dimension. Generally, feature selection methods are based on specific indicators or criterions to rank all characteristics, then realize selection through ranking scores. Most of these methods do not care about the application context in ranking. The other commonly used methods on dimension reducing is through feature transformation, such as PCA, LDA. This type of methods weakens the physical meaning of selected characteristics, and also ignore actual context. Therefore, in this paper we propose to utilize heuristic selection criterion which combining selection indicators and the application context (e.g., specific ramp study).</p>
<sec id="s3-1">
<title>Dispersion Matrix</title>
<p>First, we propose to utilize dispersion matrix (<xref ref-type="bibr" rid="B12">Gu et&#x20;al., 2017</xref>) to create selection indicator. Dispersion matrix is a mathematic tool based on feature distances of different classes, its elements are denoted as below.<disp-formula id="e14">
<mml:math id="m23">
<mml:mrow>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mi mathvariant="bold">B</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>G</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:msub>
<mml:mi>n</mml:mi>
<mml:mi>g</mml:mi>
</mml:msub>
<mml:msup>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">&#x3bc;</mml:mi>
<mml:mi>g</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">&#x3bc;</mml:mi>
<mml:mn>0</mml:mn>
</mml:msub>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mi>T</mml:mi>
</mml:msup>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">&#x3bc;</mml:mi>
<mml:mi>g</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">&#x3bc;</mml:mi>
<mml:mn>0</mml:mn>
</mml:msub>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>G</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>n</mml:mi>
<mml:mi>g</mml:mi>
</mml:msub>
</mml:mrow>
</mml:munderover>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">x</mml:mi>
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">&#x3bc;</mml:mi>
<mml:mi>g</mml:mi>
</mml:msub>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mi>T</mml:mi>
</mml:msup>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">x</mml:mi>
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mo>,</mml:mo>
<mml:mi>k</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">&#x3bc;</mml:mi>
<mml:mi>g</mml:mi>
</mml:msub>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>k</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1,2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>n</mml:mi>
<mml:mi>g</mml:mi>
</mml:msub>
<mml:mo>;</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1,2</mml:mn>
<mml:mo>,</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>,</mml:mo>
<mml:mi>G</mml:mi>
<mml:mo>;</mml:mo>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:mtext>&#x2009;</mml:mtext>
<mml:msub>
<mml:mi>n</mml:mi>
<mml:mn>1</mml:mn>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:msub>
<mml:mi>n</mml:mi>
<mml:mn>2</mml:mn>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>&#x2b;</mml:mo>
<mml:msub>
<mml:mi>n</mml:mi>
<mml:mi>g</mml:mi>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>N</mml:mi>
<mml:mo>)</mml:mo>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(14)</label>
</disp-formula>where: <bold>
<italic>W</italic>
</bold> and <bold>
<italic>B</italic>
</bold> are the dispersion matrix representing intra-class and inter-classes, respectively; <bold>
<italic>x</italic>
</bold>
<sub>
<italic>g,k</italic>
</sub> is characteristic vector of the <italic>kth</italic> ramp in the <italic>gth</italic> class; <italic>&#x3bc;</italic>
<sub>
<italic>g</italic>
</sub> and <italic>&#x3bc;</italic>
<sub>
<italic>o</italic>
</sub> represent the average vector of the <italic>gth</italic> class and all classes, respectively; <italic>n</italic>
<sub>
<italic>g</italic>
</sub> and <italic>N</italic> are the number of ramps the <italic>gth</italic> class and all classes, respectively; <italic>G</italic> is the number of classes. A Wilks criterion function <italic>&#x3bb;</italic>
<sub>
<italic>p</italic>
</sub> could be selected as the reference indicator in feature selection, it is defined as below.<disp-formula id="e15">
<mml:math id="m24">
<mml:mrow>
<mml:msub>
<mml:mi>&#x3bb;</mml:mi>
<mml:mi>p</mml:mi>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(15)</label>
</disp-formula>where: <bold>
<italic>T</italic>
</bold> is total dispersion matrix, calculated as <bold>
<italic>T</italic>&#x20;&#x3d; <italic>B</italic>
</bold> &#x2b; <bold>
<italic>W</italic>
</bold>; <italic>p</italic> is the dimension of feature space. When the value of <italic>&#x3bb;</italic>
<sub>
<italic>p</italic>
</sub> is small, implying a small value of &#x7c;<bold>
<italic>W</italic>
</bold>&#x7c; and a large value of &#x7c;<bold>
<italic>T</italic>
</bold>&#x7c;, it illustrates that the characteristic is effective to distinguish different classes of samples. Generally, the statistical indicator <italic>&#x3bb;</italic>
<sub>
<italic>p</italic>
</sub> is assumed to obey the Wilks distribution. By deciding a testing level &#x3b1; and its corresponding threshold <italic>&#x3bb;</italic>
<sub>(&#x3b1;)</sub>, the hypothesis testing of <italic>&#x3bb;</italic>
<sub>
<italic>p</italic>
</sub> could be implemented. For the convenience of calculation, the value of Wilks distribution function could be estimated by the following two common distribution functions.<list list-type="simple">
<list-item>
<p>1) Bartlett approximation.</p>
</list-item>
</list>
<disp-formula id="e16">
<mml:math id="m25">
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mfrac>
<mml:mn>1</mml:mn>
<mml:mn>2</mml:mn>
</mml:mfrac>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>p</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x22c5;</mml:mo>
<mml:mi>ln</mml:mi>
<mml:mo>&#x2061;</mml:mo>
<mml:msub>
<mml:mi>&#x3bb;</mml:mi>
<mml:mi>p</mml:mi>
</mml:msub>
<mml:mo>&#x223c;</mml:mo>
<mml:msup>
<mml:mi>&#x3c7;</mml:mi>
<mml:mn>2</mml:mn>
</mml:msup>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>p</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(16)</label>
</disp-formula>
<list list-type="simple">
<list-item>
<p>2) Rao approximation.</p>
</list-item>
</list>
<disp-formula id="e17">
<mml:math id="m26">
<mml:mrow>
<mml:mfrac>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>p</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>g</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x22c5;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3bb;</mml:mi>
<mml:mrow>
<mml:mi>p</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3bb;</mml:mi>
<mml:mi>p</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x223c;</mml:mo>
<mml:mi>F</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>p</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(17)</label>
</disp-formula>Through the above two approximation methods, the hypothesis testing of Wilks distribution could be realized by formulas in <xref ref-type="disp-formula" rid="e16">Eqs 16</xref>,&#x20;<xref ref-type="disp-formula" rid="e17">17</xref>.</p>
</sec>
<sec id="s3-2">
<title>Heuristic Selection</title>
<p>Combining the selected Wilks indicator <italic>&#x3bb;</italic>
<sub>
<italic>p</italic>
</sub> and ramps&#x2019; categories information, a supervised heuristic method could realize high-performance feature selection. In this paper, we propose to utilize SFFS (sequential floating forward search) and SFBS (sequential floating backward search) algorithms (<xref ref-type="bibr" rid="B11">Gan et&#x20;al., 2014</xref>) which retain the strengths and improve the weakness of SFS (sequential forward selection) and SBS (sequential backward selection).</p>
<p>Considering the specificity of ramp studies, the basic characteristic vector <italic>C</italic>
<sub>
<italic>v</italic>0</sub> contains basic ramp characteristics identifying ramps and non-ramps, so it is necessary included in the characteristic subset. Actually, the task of feature selection is to select optimal newly-extracted characteristics in ramp&#x20;study.</p>
<p>Therefore, in this paper the initial subset is <bold>
<italic>X</italic>
</bold>
<sub>0</sub>, the characteristics that need to be processed are wavelet energy characteristics <italic>P</italic>
<sub>
<italic>i</italic>
</sub> (<italic>i</italic>&#x20;&#x3d; 1,2, &#x22ef;, <italic>j</italic>
<sub>
<italic>n</italic>
</sub>). Assuming after the <italic>mth</italic> selection step, the feature subset is denoted as <bold>
<italic>X</italic>
</bold>
<sub>
<italic>m</italic>
</sub>. If we consider to add a new characteristic <italic>x</italic>
<sub>
<italic>r</italic>
</sub> at the (<italic>m</italic>&#x2b;1)<sup>
<italic>th</italic>
</sup> step by SFFS algorithm, the updated dispersion matrix could be calculated as below.<disp-formula id="e18">
<mml:math id="m27">
<mml:mrow>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mi mathvariant="normal">&#x27;</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>11</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>21</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mi mathvariant="normal">&#x27;</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>11</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>21</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(18)</label>
</disp-formula>where, <bold>
<italic>W</italic>
</bold>
<sub>11</sub> and <bold>
<italic>T</italic>
</bold>
<sub>11</sub> are the intra-class and the total dispersion matrix of <bold>
<italic>X</italic>
</bold>
<sub>
<italic>m</italic>
</sub>, respectively; The rest of sub-matrix are newly introduced matrix related with <italic>x</italic>
<sub>
<italic>r</italic>
</sub>, calculated as the following formulas.<disp-formula id="e19">
<mml:math id="m28">
<mml:mrow>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mrow>
<mml:mtable>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>w</mml:mi>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>w</mml:mi>
<mml:mrow>
<mml:mn>2</mml:mn>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>w</mml:mi>
<mml:mrow>
<mml:mi>p</mml:mi>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mi>T</mml:mi>
</mml:msup>
<mml:mo>;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>21</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:msubsup>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
<mml:mi>T</mml:mi>
</mml:msubsup>
<mml:mo>;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi>w</mml:mi>
<mml:mrow>
<mml:mi>r</mml:mi>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>;</mml:mo>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>t</mml:mi>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>t</mml:mi>
<mml:mrow>
<mml:mn>2</mml:mn>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>,</mml:mo>
<mml:mo>&#x22ef;</mml:mo>
<mml:mo>,</mml:mo>
<mml:msub>
<mml:mi>t</mml:mi>
<mml:mrow>
<mml:mi>p</mml:mi>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mi>T</mml:mi>
</mml:msup>
<mml:mo>;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>21</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:msubsup>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
<mml:mi>T</mml:mi>
</mml:msubsup>
<mml:mo>;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi>t</mml:mi>
<mml:mrow>
<mml:mi>r</mml:mi>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>;</mml:mo>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(19)</label>
</disp-formula>Based on calculation of these sub-matrixes, the updated indicator &#x3bb;<sub>m&#x2b;1</sub> could be calculated as below.<disp-formula id="e20">
<mml:math id="m29">
<mml:mrow>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:msub>
<mml:mi>&#x3bb;</mml:mi>
<mml:mrow>
<mml:mi>m</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mi mathvariant="normal">&#x27;</mml:mi>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mi mathvariant="normal">&#x27;</mml:mi>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>11</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>21</mml:mn>
</mml:mrow>
</mml:msub>
<mml:msubsup>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>11</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>11</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>21</mml:mn>
</mml:mrow>
</mml:msub>
<mml:msubsup>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>11</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x3d;</mml:mo>
<mml:msub>
<mml:mi>&#x3bb;</mml:mi>
<mml:mi>m</mml:mi>
</mml:msub>
<mml:mo>&#x22c5;</mml:mo>
<mml:msub>
<mml:mi>A</mml:mi>
<mml:mi>r</mml:mi>
</mml:msub>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:msub>
<mml:mi>A</mml:mi>
<mml:mi>r</mml:mi>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>21</mml:mn>
</mml:mrow>
</mml:msub>
<mml:msubsup>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>11</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:msub>
<mml:mi mathvariant="bold">W</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo>&#x7c;</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>22</mml:mn>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>21</mml:mn>
</mml:mrow>
</mml:msub>
<mml:msubsup>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>11</mml:mn>
</mml:mrow>
<mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msubsup>
<mml:msub>
<mml:mi mathvariant="bold">T</mml:mi>
<mml:mrow>
<mml:mn>12</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>&#x7c;</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mfrac>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(20)</label>
</disp-formula>By substituting <xref ref-type="disp-formula" rid="e15">Eqs 15</xref>&#x2013;<xref ref-type="disp-formula" rid="e18">18</xref>, the expression <inline-formula id="inf10">
<mml:math id="m30">
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3bb;</mml:mi>
<mml:mi>m</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>&#x3bb;</mml:mi>
<mml:mrow>
<mml:mi>m</mml:mi>
<mml:mo>&#x2b;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:math>
</inline-formula> could be replaced by <inline-formula id="inf11">
<mml:math id="m31">
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>A</mml:mi>
<mml:mi>r</mml:mi>
</mml:msub>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mi>A</mml:mi>
<mml:mi>r</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:math>
</inline-formula>. Then, the estimated value of testing <italic>x</italic>
<sub>
<italic>r</italic>
</sub> is denoted as <italic>F</italic>
<sub>1<italic>r</italic>
</sub>, expressed as below<disp-formula id="e21">
<mml:math id="m32">
<mml:mrow>
<mml:msub>
<mml:mi>F</mml:mi>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>A</mml:mi>
<mml:mi>r</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>A</mml:mi>
<mml:mi>r</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x22c5;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mi>m</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>g</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfrac>
<mml:mtext>&#x223c;</mml:mtext>
<mml:mi>F</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mi>m</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(21)</label>
</disp-formula>where: <italic>p</italic>
<sub>
<italic>m</italic>
</sub> is the number of characteristics in set <bold>
<italic>X</italic>
</bold>
<sub>
<italic>m</italic>
</sub>. If <italic>F</italic>
<sub>1<italic>r</italic>
</sub>&#x3e;<italic>F</italic>
<sub>
<italic>&#x3b1;</italic>
</sub>(<italic>g-</italic>1<italic>, N-p</italic>
<sub>
<italic>m</italic>
</sub>
<italic>-g</italic>) at given testing level <italic>&#x3b1;</italic>, then the hypothesis is correct and <italic>x</italic>
<sub>
<italic>r</italic>
</sub> is added into characteristic vector.</p>
<p>Similarly, if we utilize the SFBS algorithm to delete a characteristic <italic>x</italic>
<sub>
<italic>r</italic>
</sub> form the set <bold>
<italic>X</italic>
</bold>
<sub>
<italic>m</italic>
</sub>, the final testing value is defined as <italic>F</italic>
<sub>2<italic>r</italic>
</sub>, expressed as below<disp-formula id="e22">
<mml:math id="m33">
<mml:mrow>
<mml:msub>
<mml:mi>F</mml:mi>
<mml:mrow>
<mml:mn>2</mml:mn>
<mml:mi>r</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>A</mml:mi>
<mml:mi>r</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:msub>
<mml:mi>A</mml:mi>
<mml:mi>r</mml:mi>
</mml:msub>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x22c5;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mi>m</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>g</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mi>g</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x223c;</mml:mo>
<mml:mi>F</mml:mi>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>,</mml:mo>
<mml:mi>N</mml:mi>
<mml:mo>&#x2212;</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:msub>
<mml:mi>p</mml:mi>
<mml:mi>m</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>)</mml:mo>
</mml:mrow>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>g</mml:mi>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(22)</label>
</disp-formula>If the formula <italic>F</italic>
<sub>2<italic>r</italic>
</sub> &#x2264; <italic>F</italic>
<sub>
<italic>&#x3b1;</italic>
</sub>(<italic>g-</italic>1<italic>, N-</italic>(<italic>p</italic>
<sub>
<italic>m</italic>
</sub>
<italic>-</italic>1)<italic>-g</italic>) is satisfied at a given level &#x3b1;, then the variable <italic>x</italic>
<sub>
<italic>r</italic>
</sub> is regarded as invalid and removed from&#x20;<bold>X</bold>
<sub>
<italic>m</italic>
</sub>.</p>
</sec>
</sec>
<sec id="s4">
<title>Ramp Anomaly Analysis and Evaluation</title>
<p>By taking the selected ramp characteristics as inputs and different types of data as output, we could construct models for different ramp study, e.g., ramp classification and ramp prediction. In this paper, we only do some simple experiments on these two studies for evaluating the selected ramp characteristics.</p>
<sec id="s4-1">
<title>Ramp Classification</title>
<p>In ramp classification study, class labels of historical ramp events are taken as the output. The classification model can be constructed by data mining algorithms. To accurately classify ramp events, four data mining algorithms are applied to train ramp classification model, including support vector machine (SVM), neural networks (NN), random forests algorithm (RF) and boosted trees (BT) (<xref ref-type="bibr" rid="B4">Chen et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B20">Ouyang et&#x20;al., 2017c</xref>; <xref ref-type="bibr" rid="B15">He et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B18">Ouyang, 2021</xref>). The optimal classification model could be determined by the comparison of their performance.</p>
<p>To evaluate the classification performance, the confusion matrix introduced from information retrieval (IR) field is widely applied (<xref ref-type="bibr" rid="B13">He et&#x20;al., 2013b</xref>). The detailed expression is presented in the following&#x20;table.</p>
<p>In <xref ref-type="table" rid="T1">Table&#x20;1</xref>, four types of events are defined, such as true positive event (TP), false negative event (FN), false positive event (FP) and true negative event (TN). Based on these events, several indicators could be defined to evaluate classification performance. Four representative indicators are defined as below.<disp-formula id="e23">
<mml:math id="m34">
<mml:mrow>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mi>Re</mml:mi>
<mml:mi>c</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>TP</mml:mtext>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>TP</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>FN</mml:mtext>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mi>Pr</mml:mi>
<mml:mi>e</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>TP</mml:mtext>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>TP</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>FP</mml:mtext>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mi>A</mml:mi>
<mml:mi>c</mml:mi>
<mml:mi>c</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>TP</mml:mtext>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>TN</mml:mtext>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mrow>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mtext>All</mml:mtext>
</mml:mrow>
</mml:msub>
</mml:mrow>
</mml:mrow>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mi>E</mml:mi>
<mml:mi>r</mml:mi>
<mml:mi>r</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
<mml:mo>&#x2212;</mml:mo>
<mml:mi>A</mml:mi>
<mml:mi>c</mml:mi>
<mml:mi>c</mml:mi>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(23)</label>
</disp-formula>where, <italic>num</italic>
<sub>X</sub> represents the number of the specific event X; <italic>Pre</italic> represents precision indicator implying the percentage of TP in classified true events; <italic>Rec</italic> represents recall indicator implying the percentage of TP in observed true events; <italic>Acc</italic> is the classification accuracy, and <italic>Err</italic> is the classification error. By utilizing these four indicators, we could complete selection of the optimal classification model and the evaluation of classification performance.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Confusion matrix.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th rowspan="2" colspan="2" align="left"/>
<th colspan="2" align="center">Observation</th>
<th rowspan="2" align="center">Total</th>
</tr>
<tr>
<th align="center">True</th>
<th align="center">False</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td rowspan="2" align="left">Classification</td>
<td align="center">True</td>
<td align="center">TP</td>
<td align="center">FP</td>
<td align="center">True classification</td>
</tr>
<tr>
<td align="center">False</td>
<td align="center">FN</td>
<td align="center">TN</td>
<td align="center">False classification</td>
</tr>
<tr>
<td colspan="2" align="left">Total</td>
<td align="center">True observation</td>
<td align="center">False observation</td>
<td align="center">All</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s4-2">
<title>Ramp Prediction</title>
<p>Ramp prediction is usually divided into two types: event prediction and regression prediction. Event prediction includes ramp detection and ramp classification study. Regression prediction mainly focus on utilizing traditional regression models to predict ramp characteristics, e.g., the ramp rate prediction in (<xref ref-type="bibr" rid="B31">Zheng and Kusiak, 2009</xref>). In this paper, we consider predicting two characteristics: ramp amplitude and ramp rate, which implies values of these two characteristics are taken as the output in modeling. Since the above study on ramp characteristics&#x2019; extraction and selection are based on historical ramp events which randomly occur in wind power time series. Therefore, we propose to utilize these characteristics extracted from wind power in a given time window as inputs, then predict one appointed characteristic in the predicted time window, e.g., to predict ramp amplitude or ramp rate in the future 1-h horizon. Since this type of prediction is still based on regression models, the performance indicator could be decided by the commonly used root-mean-square error (RMSE), which is defined as below.<disp-formula id="e24">
<mml:math id="m35">
<mml:mrow>
<mml:mi>R</mml:mi>
<mml:mi>M</mml:mi>
<mml:mi>S</mml:mi>
<mml:mi>E</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:msqrt>
<mml:mrow>
<mml:mrow>
<mml:mrow>
<mml:mstyle displaystyle="true">
<mml:munderover>
<mml:mo>&#x2211;</mml:mo>
<mml:mrow>
<mml:mi>k</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>1</mml:mn>
</mml:mrow>
<mml:mi>K</mml:mi>
</mml:munderover>
<mml:mrow>
<mml:msup>
<mml:mrow>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mi>k</mml:mi>
</mml:msub>
<mml:mo>&#x2212;</mml:mo>
<mml:msub>
<mml:mi>y</mml:mi>
<mml:mi>k</mml:mi>
</mml:msub>
</mml:mrow>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
<mml:mn>2</mml:mn>
</mml:msup>
</mml:mrow>
</mml:mstyle>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mi>K</mml:mi>
</mml:mrow>
</mml:mrow>
</mml:msqrt>
</mml:mrow>
</mml:math>
<label>(24)</label>
</disp-formula>where, <italic>y</italic>
<sub>
<italic>k</italic>
</sub> and <inline-formula id="inf12">
<mml:math id="m36">
<mml:mrow>
<mml:msub>
<mml:mrow>
<mml:mover accent="true">
<mml:mi>y</mml:mi>
<mml:mo>&#x5e;</mml:mo>
</mml:mover>
</mml:mrow>
<mml:mi>k</mml:mi>
</mml:msub>
</mml:mrow>
</mml:math>
</inline-formula>are the <italic>kth</italic> values predicted and observed of an appointed ramp characteristic; <italic>K</italic> is the number of tested samples.</p>
</sec>
</sec>
<sec id="s5">
<title>Experiments and Discussion</title>
<p>In this paper, the industrial wind power data from Bonneville Power Administration (BPA) website (<xref ref-type="bibr" rid="B2">bpa.gov/transmission, 2013</xref>) is taken as the studied case. The data set spanning from 01/01/13 00:00 to 12/31/13 23:55 totally has 105,120 data points with a sampling interval of 5&#xa0;min. First, we need to detect historical ramp events from wind power time series for the following ramp characteristics study. According to the definitions in <xref ref-type="disp-formula" rid="e1">Eqs 1</xref>&#x2013;<xref ref-type="disp-formula" rid="e4">4</xref>, the forth definition can reflect three basic ramp characteristics more conveniently, so that it is selected to identify historical ramps in this paper. In (<xref ref-type="bibr" rid="B25">Tang et&#x20;al., 2021</xref>), the value of <italic>R</italic>
<sub>
<italic>val</italic>
</sub> was chosen as 50% of the installed capacity within 4&#xa0;h, so the value of <italic>R</italic>
<sub>
<italic>val</italic>
</sub> is computed by considering the capacity of 4,500&#xa0;MW in the studied case, as below.<disp-formula id="e25">
<mml:math id="m37">
<mml:mrow>
<mml:msub>
<mml:mi>R</mml:mi>
<mml:mrow>
<mml:mi>v</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>50</mml:mn>
<mml:mo>%</mml:mo>
<mml:mo>&#x22c5;</mml:mo>
<mml:msub>
<mml:mi>P</mml:mi>
<mml:mrow>
<mml:mi>t</mml:mi>
<mml:mi>o</mml:mi>
<mml:mi>t</mml:mi>
<mml:mi>a</mml:mi>
<mml:mi>l</mml:mi>
</mml:mrow>
</mml:msub>
</mml:mrow>
<mml:mrow>
<mml:mn>4</mml:mn>
<mml:mi>h</mml:mi>
<mml:mi>o</mml:mi>
<mml:mi>u</mml:mi>
<mml:mi>r</mml:mi>
<mml:mi>s</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x3d;</mml:mo>
<mml:mfrac>
<mml:mrow>
<mml:mn>50</mml:mn>
<mml:mo>%</mml:mo>
<mml:mo>&#x2217;</mml:mo>
<mml:mn>4500</mml:mn>
<mml:mi>M</mml:mi>
<mml:mi>W</mml:mi>
</mml:mrow>
<mml:mrow>
<mml:mn>4</mml:mn>
<mml:mi>h</mml:mi>
</mml:mrow>
</mml:mfrac>
<mml:mo>&#x3d;</mml:mo>
<mml:mn>562</mml:mn>
<mml:mtext>.</mml:mtext>
<mml:mn>5</mml:mn>
<mml:mtext>&#xa0;</mml:mtext>
<mml:mrow>
<mml:mrow>
<mml:mi>M</mml:mi>
<mml:mi>W</mml:mi>
</mml:mrow>
<mml:mo>/</mml:mo>
<mml:mi>h</mml:mi>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(25)</label>
</disp-formula>Considering ramps always have a duration larger than 0.5&#xa0;h, so we assume the minimum threshold as <italic>&#x2206;t</italic> &#x3d; 0.5&#xa0;h there are totally 526 ramp events are detected from data of former 6&#xa0;months. One part of ramp identification results is shown in <xref ref-type="fig" rid="F3">Figure&#x20;3</xref>. The subpicture 1) and 2) depict historical wind power and ramp events, respectively. In <xref ref-type="fig" rid="F3">Figure&#x20;3B</xref>, up-ramps and down-ramps are expressed by lines above and below the X-axis, respectively, their durations are reflected by values in Y-axis. It is seen than most of ramps have duration around hours, some even reach 6&#xa0;h.</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Identification of <bold>(A)</bold> historical wind power <bold>(B)</bold> ramp events in May.</p>
</caption>
<graphic xlink:href="fenrg-09-756733-g003.tif"/>
</fig>
<p>Historical wind power and ramp events are depicted in <xref ref-type="fig" rid="F3">Figure&#x20;3A</xref> and <xref ref-type="fig" rid="F3">Figure&#x20;3B</xref>, respectively. In <xref ref-type="fig" rid="F3">Figure&#x20;3B</xref>, up-ramps and down-ramps are expressed by lines above and below the X-axis, respectively, their durations are reflected by values in Y-axis.</p>
<sec id="s5-1">
<title>Selection of Ramp Characteristics</title>
<p>Through analysis on ramp definitions, basic ramp characteristics (amplitude, duration, and ramp rate) could be extracted, as (5). These basic characteristics could be used to identify ramps and non-ramps, as two typical signals in <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>. To identify more detailed division of ramp categories, wavelet transformation is proposed to extract profound characteristics.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Wavelet analysis of ramps and non-ramps; <bold>(A)</bold> non-ramp signal; <bold>(B)</bold> ramp signal.</p>
</caption>
<graphic xlink:href="fenrg-09-756733-g004.tif"/>
</fig>
<p>In order to illustrate the feasibility of wavelet characteristics, we firstly utilize wavelet coefficients as an index to qualitatively analyze ramps and non-ramps.</p>
<p>In <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>, the two typical ramp and non-ramp events are identified by characteristics in <xref ref-type="disp-formula" rid="e5">Eq. 5</xref>. The function applied here is Haar wavelet which was validated useful in ramp analysis (<xref ref-type="bibr" rid="B10">Gallego et&#x20;al., 2013</xref>). It is seen from <xref ref-type="fig" rid="F4">Figure&#x20;4</xref> that wavelet coefficients which reflect signal&#x2019;s energy could obviously distinguish ramps and non-ramps. For example, ramps have larger coefficients than non-ramps. It verifies the validity of wavelet transformation in ramp characteristics analysis, therefore we could further extract more profound wavelet characteristics for ramp recognition.</p>
<p>According to the heuristic methods in selecting characteristics, the class labels are required. Therefore, we propose to construct ramp classification according to a specific context. Considering wind process are formed by different meteorological phenomena, so the categories of ramp events are related to division wind processes to some extent. In (<xref ref-type="bibr" rid="B28">Wang et&#x20;al., 2013</xref>), five types of wind process are discussed, namely small wind, small fluctuation wind, large fluctuation wind, double peak wind and multi-peaks wind. However, there are a few ramp events attributed to the small wind. Double peaks wind can be regarded as a special type of multi-peaks wind. Based on these assumptions, we can group historical ramp events into the following category library <bold>L,</bold> denoted as below.<disp-formula id="e26">
<mml:math id="m38">
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mi mathvariant="bold">L</mml:mi>
<mml:mi mathvariant="normal">&#x3d;{A,&#xa0;B,&#xa0;C}</mml:mi>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mrow>
<mml:mo>{</mml:mo>
<mml:mtable columnalign="left">
<mml:mtr>
<mml:mtd>
<mml:mi mathvariant="normal">A&#x3d;{small&#xa0;wind,small&#xa0;fluctuation&#xa0;wind};</mml:mi>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mi mathvariant="normal">B&#x3d;large&#xa0;fluctuation&#xa0;wind;</mml:mi>
</mml:mtd>
</mml:mtr>
<mml:mtr>
<mml:mtd>
<mml:mi mathvariant="normal">C&#x3d;{double&#xa0;peaks&#xa0;wind,&#xa0;multi-peaks&#xa0;wind};</mml:mi>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:mrow>
</mml:mtd>
</mml:mtr>
</mml:mtable>
</mml:math>
<label>(26)</label>
</disp-formula>Combing with the description of wind process in (<xref ref-type="bibr" rid="B28">Wang et&#x20;al., 2013</xref>) and the constructed library <bold>L</bold>, historical ramp events of training set are classified into three classes, as presented&#x20;below.</p>
<p>
<xref ref-type="table" rid="T2">Table&#x20;2</xref> shows the statistical results of ramp events belonging to three categories in <bold>L</bold>, where number 1, 2 and 3 are defined as the class labels of A, B, C. It is seen that most ramp events are associated with the large fluctuation wind, a few of ramp events associated with the small wind and multi-peak wind. These results agree with the concept of ramp events involving a large change of wind power. Therefore, the constructed application context is reasonable for studying ramp characteristics. Based on the constructed library of ramp categories, then the extraction and selection of ramp characteristics could be implemented.</p>
<table-wrap id="T2" position="float">
<label>TABLE 2</label>
<caption>
<p>Number of ramps in three categories.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left">Class label</th>
<th align="center">1</th>
<th align="center">2</th>
<th align="center">3</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Number</td>
<td align="char" char=".">101</td>
<td align="char" char=".">378</td>
<td align="char" char=".">47</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Assuming each signal is decomposed into five wavelet layers, the energy of each wavelet layer is extracted as ramp characteristics by <xref ref-type="disp-formula" rid="e13">Eq. 13</xref>, expressed as <bold>P</bold> &#x3d; [P<sub>1</sub>,P<sub>2</sub>,P<sub>3</sub>,P<sub>4</sub>,P<sub>5</sub>]. Here, the number of decomposition layers is set as 5 since ramp events have only three categories in this paper. In other application context which requires more refined ramp classification, the level of decomposition could be higher. As the description in <italic>Feature Selection</italic>, the purpose of feature selection is to delete redundant characteristics, reduce dimension and computation cost. Combining ramp basic characteristics and extracted wavelet energy characteristics, the characteristic vector is expressed as <italic>C</italic>
<sub>
<italic>v</italic>
</sub> &#x3d; [<italic>Wp</italic>
<sub>
<italic>max</italic>
</sub>, <italic>Wp</italic>
<sub>
<italic>min</italic>
</sub>, <italic>T</italic>, <italic>R</italic>, <italic>P</italic>
<sub>1</sub>, <italic>P</italic>
<sub>2</sub>, <italic>P</italic>
<sub>3</sub>, <italic>P</italic>
<sub>4</sub>, <italic>P</italic>
<sub>5</sub>]. For all historical ramp events, the feature set constructed by <italic>C</italic>
<sub>
<italic>v</italic>
</sub> is denoted as <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>. Then, according to the selection algorithm in <italic>Feature Selection</italic>, the process is shown in the following&#x20;table.</p>
<p>At each step of <xref ref-type="table" rid="T3">Table&#x20;3</xref>, the value of <italic>&#x3bb;</italic>
<sub>
<italic>p</italic>
</sub> is calculated for the rest characteristics <italic>P</italic>
<sub>
<italic>i</italic>
</sub> first. Then the minimum one is applied for <italic>F</italic>
<sub>
<italic>r</italic>
</sub> testing based on <xref ref-type="disp-formula" rid="e15">Eqs 15</xref>, <xref ref-type="disp-formula" rid="e16">16</xref>. If the result is satisfied, adding the corresponding characteristic into characteristic vector <italic>C</italic>
<sub>
<italic>v</italic>
</sub>. It is seen from <xref ref-type="table" rid="T3">Table&#x20;3</xref> that <italic>P</italic>
<sub>3</sub> and <italic>P</italic>
<sub>4</sub> is selected, so the final characteristic is re-written as <italic>C</italic>
<sub>
<italic>vp</italic>
</sub> &#x3d; [<italic>Wp</italic>
<sub>
<italic>max</italic>
</sub>, <italic>Wp</italic>
<sub>
<italic>min</italic>
</sub>, <italic>T</italic>, <italic>R</italic>, <italic>P</italic>
<sub>3</sub>, <italic>P</italic>
<sub>4</sub>], and the final feature set for all ramp events as&#x20;<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub>.</p>
<table-wrap id="T3" position="float">
<label>TABLE 3</label>
<caption>
<p>Process of featue selection.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th align="left"/>
<th align="center">P<sub>1</sub>
</th>
<th align="center">P<sub>2</sub>
</th>
<th align="center">P<sub>3</sub>
</th>
<th align="center">P<sub>4</sub>
</th>
<th align="center">P<sub>5</sub>
</th>
<th align="center">Selection</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Step 1</td>
<td align="char" char=".">0.3064</td>
<td align="char" char=".">0.3032</td>
<td align="center">0.2969</td>
<td align="center">0.2996</td>
<td align="char" char=".">0.3146</td>
<td align="center">
<italic>P</italic>
<sub>3</sub>
</td>
</tr>
<tr>
<td align="left">Step 2</td>
<td align="char" char=".">0.2963</td>
<td align="char" char=".">0.2944</td>
<td align="center">\</td>
<td align="center">0.2917</td>
<td align="char" char=".">0.2960</td>
<td align="center">
<italic>P</italic>
<sub>4</sub>
</td>
</tr>
<tr>
<td align="left">Step 3</td>
<td align="char" char=".">0.2911</td>
<td align="char" char=".">0.2901</td>
<td align="center">\</td>
<td align="center">\</td>
<td align="char" char=".">0.2900</td>
<td align="center">None</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s5-2">
<title>Ramp Study and Discussion</title>
<p>By taking the feature set <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub> as inputs and the class labels from <xref ref-type="table" rid="T2">Table&#x20;2</xref> as output, five data mining algorithms (SVM, NN, RF, BT, ELM) are applied in ramp classification modeling. The classification results of three categories of ramps are shown in following figure.</p>
<p>For the convenience of presentation, <xref ref-type="fig" rid="F5">Figure&#x20;5</xref> utilizes two characteristics (<italic>Wp</italic>
<sub>
<italic>max</italic>
</sub>
<italic>&#xd7;P</italic>
<sub>
<italic>3</italic>
</sub>) to show ramp classification results, as X-axis representing values of <italic>Wp</italic>
<sub>
<italic>max</italic>
</sub> and Y-axis representing values of <italic>P</italic>
<sub>
<italic>3</italic>
</sub>. Red, blue and green points represent ramps of Class1, Class2 and Class3, respectively. Black points represent ramp events classified into incorrect class. Based on these classification results, the performance indicators defined in <xref ref-type="disp-formula" rid="e23">Eq. 23</xref> could be calculated, as presented&#x20;below.</p>
<fig id="F5" position="float">
<label>FIGURE 5</label>
<caption>
<p>Ramp classification based on four data mining algorithms; <bold>(A)</bold> SVM; <bold>(B)</bold> NN; <bold>(C)</bold> RF; <bold>(D)</bold> BT; <bold>(E)</bold> ELM.</p>
</caption>
<graphic xlink:href="fenrg-09-756733-g005.tif"/>
</fig>
<p>
<xref ref-type="table" rid="T4">Table&#x20;4</xref> presents values of four performance indicators in classification of three ramp categories. According to the definitions of four matrixes, a classification system performs well with large value of Pre, Rec, Acc, and small value of Err. In <xref ref-type="table" rid="T4">Table&#x20;4</xref>, it is seen that NN, RF and ELM algorithms outperform on three classes, respectively. However, it is difficult to choose the best to classify all three ramp categories. To determine the final optimal model in ramp classification, the receiver operating characteristic curve (ROC) is introduced to compare performance further. ROC space is constructed by Recall (Rec) in the X-axis and false alarm (F) in the Y-axis. The definition of F is also based on <xref ref-type="table" rid="T1">Table&#x20;1</xref>, as expressed below.<disp-formula id="e27">
<mml:math id="m39">
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mo>&#x3d;</mml:mo>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mi>P</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>/</mml:mo>
<mml:mrow>
<mml:mo>(</mml:mo>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mi>F</mml:mi>
<mml:mi>P</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>&#x2b;</mml:mo>
<mml:mi>n</mml:mi>
<mml:mi>u</mml:mi>
<mml:msub>
<mml:mi>m</mml:mi>
<mml:mrow>
<mml:mi>T</mml:mi>
<mml:mi>N</mml:mi>
</mml:mrow>
</mml:msub>
<mml:mo>)</mml:mo>
</mml:mrow>
</mml:mrow>
</mml:math>
<label>(27)</label>
</disp-formula>where, F calculates the percentage of FP in observed false events. According to these two indicators&#x2019; definitions, it is easily comprehended that a classifier having a large Rec and a small F performs better, which implies the upper-left corner of the ROC space means the better performance. For a discrete classification system, a classifier is usually represented by a point in ROC space. Therefore, points representing all classifiers in <xref ref-type="table" rid="T4">Table&#x20;4</xref> are shown in the following figure.</p>
<table-wrap id="T4" position="float">
<label>TABLE 4</label>
<caption>
<p>Performance of ramp classification.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th colspan="2" align="center"/>
<th align="center">
<italic>Pre</italic>
</th>
<th align="center">
<italic>Rec</italic>
</th>
<th align="center">
<italic>Acc</italic>
</th>
<th align="center">
<italic>Err</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td rowspan="5" align="left">Class 1</td>
<td align="center">SVM</td>
<td align="char" char=".">0.9000</td>
<td align="char" char=".">0.9802</td>
<td align="char" char=".">0.9753</td>
<td align="char" char=".">0.0247</td>
</tr>
<tr>
<td align="center">NN</td>
<td align="char" char=".">1.0000</td>
<td align="char" char=".">0.9714</td>
<td align="char" char=".">0.9946</td>
<td align="char" char=".">0.0054</td>
</tr>
<tr>
<td align="center">RF</td>
<td align="char" char=".">1.0000</td>
<td align="char" char=".">0.9683</td>
<td align="char" char=".">0.9944</td>
<td align="char" char=".">0.0056</td>
</tr>
<tr>
<td align="center">BT</td>
<td align="char" char=".">1.0000</td>
<td align="char" char=".">0.6126</td>
<td align="char" char=".">0.9183</td>
<td align="char" char=".">0.0817</td>
</tr>
<tr>
<td align="center">ELM</td>
<td align="char" char=".">0.9381</td>
<td align="char" char=".">0.9010</td>
<td align="char" char=".">0.9696</td>
<td align="char" char=".">0.0304</td>
</tr>
<tr>
<td rowspan="5" align="left">Class 2</td>
<td align="center">SVM</td>
<td align="char" char=".">0.9688</td>
<td align="char" char=".">0.9868</td>
<td align="char" char=".">0.9677</td>
<td align="char" char=".">0.0323</td>
</tr>
<tr>
<td align="center">NN</td>
<td align="char" char=".">0.9886</td>
<td align="char" char=".">0.9886</td>
<td align="char" char=".">0.9838</td>
<td align="char" char=".">0.0162</td>
</tr>
<tr>
<td align="center">RF</td>
<td align="char" char=".">0.9961</td>
<td align="char" char=".">0.9846</td>
<td align="char" char=".">0.9859</td>
<td align="char" char=".">0.0141</td>
</tr>
<tr>
<td align="center">BT</td>
<td align="char" char=".">0.8651</td>
<td align="char" char=".">0.9729</td>
<td align="char" char=".">0.8745</td>
<td align="char" char=".">0.1255</td>
</tr>
<tr>
<td align="center">ELM</td>
<td align="char" char=".">0.9739</td>
<td align="char" char=".">0.9868</td>
<td align="char" char=".">0.9715</td>
<td align="char" char=".">0.0285</td>
</tr>
<tr>
<td rowspan="5" align="left">Class 3</td>
<td align="center">SVM</td>
<td align="char" char=".">0.8065</td>
<td align="char" char=".">0.5319</td>
<td align="char" char=".">0.9468</td>
<td align="char" char=".">0.0532</td>
</tr>
<tr>
<td align="center">NN</td>
<td align="char" char=".">0.8684</td>
<td align="char" char=".">0.9167</td>
<td align="char" char=".">0.9784</td>
<td align="char" char=".">0.0216</td>
</tr>
<tr>
<td align="center">RF</td>
<td align="char" char=".">0.8333</td>
<td align="char" char=".">0.9677</td>
<td align="char" char=".">0.9802</td>
<td align="char" char=".">0.0198</td>
</tr>
<tr>
<td align="center">BT</td>
<td align="char" char=".">0.7442</td>
<td align="char" char=".">0.6957</td>
<td align="char" char=".">0.9525</td>
<td align="char" char=".">0.0475</td>
</tr>
<tr>
<td align="center">ELM</td>
<td align="char" char=".">0.9565</td>
<td align="char" char=".">0.9362</td>
<td align="char" char=".">0.9905</td>
<td align="char" char=".">0.0095</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>In <xref ref-type="fig" rid="F6">Figure&#x20;6</xref>, three points having the same type present classifiers of three classes by a same algorithm. The points representing SVM and BT perform worse than the other three algorithms again. By comparing the points of NN, RF and ELM, it is seen that points of RF obviously are concentrated and closer to the upper-left corner, implying their classifiers have a better performance. Therefore, RF algorithm is finally chosen for modeling ramp classification in this&#x20;paper.</p>
<fig id="F6" position="float">
<label>FIGURE 6</label>
<caption>
<p>Four data mining models in ROC&#x20;space.</p>
</caption>
<graphic xlink:href="fenrg-09-756733-g006.tif"/>
</fig>
<p>Then, taking these trained RF models as ramp classifiers, 100 ramp events are selected from July to December as testing samples. To discuss the performance with and without wavelet characteristics in ramp classification, three different input sets are considered in the case study, such as initial feature set <bold>
<italic>X</italic>
</bold>
<sub>0</sub> consisting of vector <italic>C</italic>
<sub>
<italic>v0</italic>
</sub>, feature set <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub> consisting of vector <italic>C</italic>
<sub>
<italic>v</italic>
</sub> &#x3d; [<italic>C</italic>
<sub>
<italic>v0</italic>
</sub>, <bold>
<italic>P</italic>
</bold>] which contains basic ramp characteristics and all wavelet characteristics, refined feature set <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub> consisting of <italic>C</italic>
<sub>
<italic>vp</italic>
</sub> &#x3d; [<italic>C</italic>
<sub>
<italic>v0</italic>
</sub>, <italic>P</italic>
<sub>3</sub>, <italic>P</italic>
<sub>4</sub>] which reduces dimension by feature selection. Classification performance of testing data is presented in the following&#x20;table.</p>
<p>
<xref ref-type="table" rid="T5">Table&#x20;5</xref> shows values of four indicators at classification of three ramp categories. Since three ramp categories have imbalance distribution as Table&#x20;2II, so the classification performance of Class 2 is the best. By comparing classification performance of using three feature sets, it is seen that using <bold>X</bold>
<sub>
<italic>p</italic>0</sub> has better performance than using <bold>
<italic>X</italic>
</bold>
<sub>0</sub>, having an average improvement of 10.17% (8.14% on Pre, 14.77% on Rec, 1.80% on Acc, 15.98% on Err). These results imply wavelet characteristics are useful in ramp classification. Also, using <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub> improves a little again (with an average improvement of 6.05%) than using <bold>X</bold>
<sub>
<italic>p</italic>0</sub>, which implies that the proposed feature selection approach is feasible and effectual in ramp classification. While, for comparing with other feature selection methods, the commonly used PCA is applied. After the analysis of PCA on <bold>
<italic>P</italic>
</bold> &#x3d; [<italic>P</italic>
<sub>1</sub>, <italic>P</italic>
<sub>2</sub>, <italic>P</italic>
<sub>3</sub>, <italic>P</italic>
<sub>4</sub>, <italic>P</italic>
<sub>5</sub>], two principal components are selected to keep a same dimension with <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub>, these two components contribute 84.00% explanation in classification, and consist of the feature set <bold>
<italic>X</italic>
</bold>
<sub>pca</sub>. Table V also presents the performance of <bold>
<italic>X</italic>
</bold>
<sub>pca</sub>. By comparing <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub> and <bold>
<italic>X</italic>
</bold>
<sub>pca</sub>, it is seen that using <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub> has an average outperformance of 3.69% than using <bold>
<italic>X</italic>
</bold>
<sub>pca</sub>. Summarizing all these results, the proposed approach on selecting wavelet characteristics is validated to be feasible.</p>
<table-wrap id="T5" position="float">
<label>TABLE 5</label>
<caption>
<p>Classification performance of different feature&#x20;sets.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th colspan="2" align="center"/>
<th align="center">
<italic>Pre</italic>
</th>
<th align="center">
<italic>Rec</italic>
</th>
<th align="center">
<italic>Acc</italic>
</th>
<th align="center">
<italic>Err</italic>
</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td rowspan="4" align="left">Class1</td>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>0</sub>
</td>
<td align="char" char=".">0.6111</td>
<td align="char" char=".">1.0000</td>
<td align="char" char=".">0.9157</td>
<td align="char" char=".">0.0843</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>
</td>
<td align="char" char=".">0.6804</td>
<td align="char" char=".">1.0000</td>
<td align="char" char=".">0.9357</td>
<td align="char" char=".">0.0643</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub>
</td>
<td align="char" char=".">0.6875</td>
<td align="char" char=".">1.0000</td>
<td align="char" char=".">0.9378</td>
<td align="char" char=".">0.0622</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>pca</sub>
</td>
<td align="char" char=".">0.6735</td>
<td align="char" char=".">1.0000</td>
<td align="char" char=".">0.9398</td>
<td align="char" char=".">0.0602</td>
</tr>
<tr>
<td rowspan="4" align="left">Class2</td>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>0</sub>
</td>
<td align="char" char=".">0.9621</td>
<td align="char" char=".">0.8945</td>
<td align="char" char=".">0.9016</td>
<td align="char" char=".">0.0984</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>
</td>
<td align="char" char=".">0.9914</td>
<td align="char" char=".">0.8934</td>
<td align="char" char=".">0.9157</td>
<td align="char" char=".">0.0843</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub>
</td>
<td align="char" char=".">1.0000</td>
<td align="char" char=".">0.8958</td>
<td align="char" char=".">0.9137</td>
<td align="char" char=".">0.0863</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>pca</sub>
</td>
<td align="char" char=".">0.9940</td>
<td align="char" char=".">0.9089</td>
<td align="char" char=".">0.8916</td>
<td align="char" char=".">0.1084</td>
</tr>
<tr>
<td rowspan="4" align="left">Class3</td>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>0</sub>
</td>
<td align="char" char=".">0.2813</td>
<td align="char" char=".">0.1875</td>
<td align="char" char=".">0.8574</td>
<td align="char" char=".">0.1426</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>
</td>
<td align="char" char=".">0.3095</td>
<td align="char" char=".">0.2708</td>
<td align="char" char=".">0.8715</td>
<td align="char" char=".">0.1285</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub>
</td>
<td align="char" char=".">0.3231</td>
<td align="char" char=".">0.4375</td>
<td align="char" char=".">0.8755</td>
<td align="char" char=".">0.1245</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>pca</sub>
</td>
<td align="char" char=".">0.3088</td>
<td align="char" char=".">0.4375</td>
<td align="char" char=".">0.8514</td>
<td align="char" char=".">0.1486</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>On the other hand, by utilizing these selected ramp characteristics, we could do some try on the study of ramp prediction. Since ramp classification has validated the effectiveness on distinguishing different categories, so two basic ramp characteristics are taken as target output in prediction, such as ramp amplitude (<italic>Var</italic>) and ramp rate (<italic>R</italic>). As the design of ramp prediction in <italic>Ramp Anomaly Analysis and Evaluation</italic>, the historical feature extraction window and the predicted time window are set as the same for convenience. In this paper, ramp prediction is designed to predict two variables (<italic>Var</italic> and <italic>R</italic>) within future horizon of 1, 2, &#x22ef;, 5&#xa0;h, the prediction performance is presented in the following&#x20;table.</p>
<p>
<xref ref-type="table" rid="T6">Table&#x20;6</xref> shows the performance of ramp prediction by RMSE of two ramp characteristics. In these two variables&#x2019; prediction, a typical NN with three layers is used in modeling. For comparison study, four feature sets discussed in <xref ref-type="table" rid="T5">Table&#x20;5</xref> are also utilized as inputs of prediction models. It is seen from results of <xref ref-type="table" rid="T6">Table&#x20;6</xref> that models using feature sets containing wavelet characteristics (e.g., <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>, <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub>, <bold>
<italic>X</italic>
</bold>
<sub>pca</sub>) outperforms than that only containing basic ramp characteristics (e.g., <bold>
<italic>X</italic>
</bold>
<sub>0</sub>). Through the proposed feature selection in this paper, the model using <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub> has an improvement of 5.97% than using <bold>
<italic>X</italic>
</bold>
<sub>0</sub>, 1.29% than using <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>, and 2.70% than using <bold>
<italic>X</italic>
</bold>
<sub>pca</sub> on prediction of <italic>Var</italic>. Similarly, using <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub> has an improvement of 16.30% than using <bold>
<italic>X</italic>
</bold>
<sub>0</sub>, 8.24% than using <bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>, and 13.07% than using <bold>
<italic>X</italic>
</bold>
<sub>pca</sub> on prediction of <italic>R</italic>. Through the discussion on results of Table VI, it is concluded that the proposed approach on extracting and selecting ramp characteristics is also useful for constructing inputs of ramp prediction, and acquires good prediction performance.</p>
<table-wrap id="T6" position="float">
<label>TABLE 6</label>
<caption>
<p>Performance of ramp prediction.</p>
</caption>
<table>
<thead valign="top">
<tr>
<th colspan="2" align="center"/>
<th align="center">1&#xa0;h</th>
<th align="center">2&#xa0;h</th>
<th align="center">3&#xa0;h</th>
<th align="center">4&#xa0;h</th>
<th align="center">5&#xa0;h</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td rowspan="4" align="left">
<italic>Var</italic>
</td>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>0</sub>
</td>
<td align="char" char=".">21.94</td>
<td align="char" char=".">40.80</td>
<td align="char" char=".">79.49</td>
<td align="char" char=".">120.42</td>
<td align="char" char=".">156.71</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>
</td>
<td align="char" char=".">19.02</td>
<td align="char" char=".">38.05</td>
<td align="char" char=".">81.63</td>
<td align="char" char=".">115.94</td>
<td align="char" char=".">151.46</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub>
</td>
<td align="char" char=".">18.68</td>
<td align="char" char=".">35.31</td>
<td align="char" char=".">86.21</td>
<td align="char" char=".">113.93</td>
<td align="char" char=".">149.46</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>pca</sub>
</td>
<td align="char" char=".">20.27</td>
<td align="char" char=".">35.63</td>
<td align="char" char=".">79.12</td>
<td align="char" char=".">122.02</td>
<td align="char" char=".">160.87</td>
</tr>
<tr>
<td rowspan="4" align="left">
<italic>R</italic>
</td>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>0</sub>
</td>
<td align="char" char=".">1.8635</td>
<td align="char" char=".">1.9418</td>
<td align="char" char=".">2.4102</td>
<td align="char" char=".">2.5717</td>
<td align="char" char=".">2.6601</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>0</sub>
</td>
<td align="char" char=".">1.7527</td>
<td align="char" char=".">1.6638</td>
<td align="char" char=".">2.0607</td>
<td align="char" char=".">2.5032</td>
<td align="char" char=".">2.4825</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>
<italic>p</italic>
</sub>
</td>
<td align="char" char=".">1.4786</td>
<td align="char" char=".">1.4928</td>
<td align="char" char=".">1.9097</td>
<td align="char" char=".">2.3972</td>
<td align="char" char=".">2.3897</td>
</tr>
<tr>
<td align="center">
<bold>
<italic>X</italic>
</bold>
<sub>pca</sub>
</td>
<td align="char" char=".">1.8355</td>
<td align="char" char=".">1.8644</td>
<td align="char" char=".">2.2158</td>
<td align="char" char=".">2.5242</td>
<td align="char" char=".">2.5728</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec sec-type="conclusion" id="s6">
<title>Conclusion</title>
<p>The study in this paper focus on extracting and selecting profound ramp characteristics for in-depth ramp researches. First, based on wavelet transformation&#x2019;s properties on time-frequency domains and multiresolution, wavelet decomposition is validated useful in analyzing ramps and non-ramps, also different categories of ramps. Then, ramp characteristics are extracted based on the energy decomposition at different wavelet layers. Combining with given ramp categories from wind process, heuristic feature selection methods (e.g., SFFS, SFBS) are applied to select valid characteristics, to remove redundant characteristics and reduce feature dimension. Based on basic ramp characteristics and selected wavelet characteristics, ramp studies on classification and prediction acquire better performance than that without wavelet characteristics and that using PCA in feature selection. Therefore, the conclusion could be summarized in this paper that wavelet transformation is useful to extract profound ramp characteristics, and that selecting ramp characteristics by the proposed approach is feasible to improve performance of ramp studies.</p>
<p>However, besides the above conclusions, there is also a number of conceptual alternatives worth discussing and pursuing: 1) ramp categories in this paper are determined by wind process. Therefore, the selected wavelet characteristics are not completely applicable to other ramp contexts. The approach involving feature extraction and selection in this paper could be still referential. 2) Ramp events generally involve complicated weather movement, it is reasonable that considering meteorological variables in ramp studies could improve the performance. While, for the limitation of data sources in this paper, we only consider ramp characteristics from wind power data. More work on exogenous variables will be studied in future. 3) Based on the selected ramp characteristics and results of some ramp studies, power system&#x2019;s operation associated with ramp events could be studied further. Besides these points, more studies are needed to in-depth understand ramp events.</p>
</sec>
</body>
<back>
<sec id="s7">
<title>Data Availability Statement</title>
<p>The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.</p>
</sec>
<sec id="s8">
<title>Author Contributions</title>
<p>PY write the paper and implement the experiments. AL supervises the whole process.</p>
</sec>
<sec id="s9">
<title>Funding</title>
<p>This work is supported by Scientific Research Fund of Hunan Provincial Education Department (20A460).</p>
</sec>
<sec sec-type="COI-statement" id="s10">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s11">
<title>Publisher&#x2019;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ashrafian</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Mirsalim</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Masoum</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>An Adaptive Recursive Wavelet Based Algorithm for Real-Time Measurement of Power System Variables during Off-Nominal Frequency Conditions</article-title>. <source>IEEE Trans. Ind. Inform.</source> <volume>14</volume>, <fpage>818</fpage>&#x2013;<lpage>828</lpage>. <pub-id pub-id-type="doi">10.1109/TII.2017.2727222</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="web">
<collab>bpa.gov/transmission</collab> (<year>2013</year>). <ext-link ext-link-type="uri" xlink:href="http://transmission.bpa.gov/Business/Operations/Wind/WindGenTotalLoadYTD_2013.xls">http://transmission.bpa.gov/Business/Operations/Wind/WindGenTotalLoadYTD_2013.xls</ext-link>.</citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chen</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Cao</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Guo</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Distilling the Knowledge from Handcrafted Features for Human Activity Recognition</article-title>. <source>IEEE Trans. Ind. Inform.</source> <volume>14</volume>, <fpage>4334</fpage>. <pub-id pub-id-type="doi">10.1109/tii.2018.2789925</pub-id> </citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Chen</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Zhu</surname>
<given-names>Q.</given-names>
</name>
<name>
<surname>Soh</surname>
<given-names>Y. C.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Robust Human Activity Recognition Using Smartphone Sensors via CT-PCA and Online SVM</article-title>. <source>IEEE Trans. Ind. Inf.</source> <volume>13</volume> (<issue>6</issue>), <fpage>3070</fpage>&#x2013;<lpage>3080</lpage>. <pub-id pub-id-type="doi">10.1109/tii.2017.2712746</pub-id> </citation>
</ref>
<ref id="B5">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Couto</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Costa</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Rodrigues</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Lopes</surname>
<given-names>V. V.</given-names>
</name>
<name>
<surname>Estanqueiro</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2013</year>). &#x201c;<article-title>Impact of Weather Regimes on the Wind Power Ramp Forecast</article-title>,&#x201d; in <conf-name>12th International Workshop on Large-Scale Integration of Wind Power into Power Systems as well as on Transmission Networks for Offshore Wind Power Plants</conf-name>, <conf-loc>London, United&#x20;Kingdom</conf-loc>, <conf-date>October 22&#x2013;24, 2013</conf-date>. </citation>
</ref>
<ref id="B6">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Doucoure</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Agbossou</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Cardenas</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Time Series Prediction Using Artificial Wavelet Neural Network and Multi-Resolution Analysis: Application to Wind Speed Data</article-title>. <source>Renew. Energ.</source> <volume>92</volume>, <fpage>202</fpage>&#x2013;<lpage>211</lpage>. <pub-id pub-id-type="doi">10.1016/j.renene.2016.02.003</pub-id> </citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Escalante Soberanis</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>M&#xe9;rida</surname>
<given-names>W.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Regarding the influence of the Van der Hoven spectrum on wind energy applications in the meteorological mesoscale and microscale</article-title>. <source>Renew. Energ.</source> <volume>81</volume>, <fpage>286</fpage>&#x2013;<lpage>292</lpage>. <pub-id pub-id-type="doi">10.1016/j.renene.2015.03.048</pub-id> </citation>
</ref>
<ref id="B8">
<citation citation-type="confproc">
<person-group person-group-type="author">
<name>
<surname>Florita</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Hodge</surname>
<given-names>B. M.</given-names>
</name>
<name>
<surname>Orwig</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2013</year>). &#x201c;<article-title>Identifying Wind and Solar Ramping Events</article-title>,&#x201d; in <conf-name>IEEE 5th Green Technologies Conference</conf-name>, <conf-loc>Denver, CO</conf-loc>, <conf-date>4-5 April 2013</conf-date> (<publisher-name>IEEE</publisher-name>). <pub-id pub-id-type="doi">10.1109/GreenTech.2013.30</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Francis</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2008</year>). <source>Predicting Sudden Changes in Wind Power Generation</source>, <volume>58</volume>. <publisher-loc>Honolulu</publisher-loc>: <publisher-name>North American Wind Power</publisher-name>.</citation>
</ref>
<ref id="B10">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gallego</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Costa</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Cuerva</surname>
<given-names>&#xc1;.</given-names>
</name>
<name>
<surname>Landberg</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Greaves</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Collins</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>A Wavelet-Based Approach for Large Wind Power Ramp Characterisation</article-title>. <source>Wind Energy</source> <volume>16</volume> (<issue>2</issue>), <fpage>257</fpage>&#x2013;<lpage>278</lpage>. <pub-id pub-id-type="doi">10.1002/we.550</pub-id> </citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gan</surname>
<given-names>J.&#x20;Q.</given-names>
</name>
<name>
<surname>Awwad Shiekh Hasan</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Tsui</surname>
<given-names>C. S. L.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>A Filter-Dominating Hybrid Sequential Forward Floating Search Method for Feature Subset Selection in High-Dimensional Space</article-title>. <source>Int. J.&#x20;Mach. Learn. Cyber.</source> <volume>5</volume> (<issue>3</issue>), <fpage>413</fpage>&#x2013;<lpage>423</lpage>. <pub-id pub-id-type="doi">10.1007/s13042-012-0139-z</pub-id> </citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gu</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Sun</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Sheng</surname>
<given-names>V. S.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Structural Minimax Probability Machine</article-title>. <source>IEEE Trans. Neural Netw. Learn. Syst.</source> <volume>28</volume> (<issue>7</issue>), <fpage>1646</fpage>&#x2013;<lpage>1656</lpage>. <pub-id pub-id-type="doi">10.1109/tnnls.2016.2544779</pub-id> </citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>He</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Vittal</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Online Dynamic Security Assessment with Missing Pmu Measurements: A Data Mining Approach</article-title>. <source>IEEE Trans. Power Syst.</source> <volume>28</volume> (<issue>2</issue>), <fpage>1969</fpage>&#x2013;<lpage>1977</lpage>. <pub-id pub-id-type="doi">10.1109/tpwrs.2013.2246822</pub-id> </citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>He</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Li</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>A Real-Time Power Quality Disturbances Classification Using Hybrid Method Based on S-Transform and Dynamics</article-title>. <source>IEEE Trans. Instrum. Meas.</source> <volume>62</volume> (<issue>9</issue>), <fpage>2465</fpage>&#x2013;<lpage>2475</lpage>. <pub-id pub-id-type="doi">10.1109/tim.2013.2258761</pub-id> </citation>
</ref>
<ref id="B15">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>He</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Kusiak</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Teng</surname>
<given-names>W.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Data-driven Modeling of Truck Engine Exhaust Valve Failures: a Case Study</article-title>. <source>J.&#x20;Mech. Sci. Technol.</source> <volume>31</volume> (<issue>6</issue>), <fpage>2747</fpage>&#x2013;<lpage>2757</lpage>. <pub-id pub-id-type="doi">10.1007/s12206-017-0518-1</pub-id> </citation>
</ref>
<ref id="B16">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Huang</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Zha</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Xiong</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>W.</given-names>
</name>
<etal/>
</person-group> (<year>2018</year>). <article-title>Robust Bad Data Detection Method for Microgrid Using Improved ELM and DBSCAN Algorithm</article-title>. <source>J.&#x20;Energ. Eng.</source> <volume>144</volume> (<issue>3</issue>), <fpage>04018026</fpage>. <pub-id pub-id-type="doi">10.1061/(asce)ey.1943-7897.0000544</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mohanty</surname>
<given-names>S. R.</given-names>
</name>
<name>
<surname>Kishor</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Ray</surname>
<given-names>P. K.</given-names>
</name>
<name>
<surname>Catalao</surname>
<given-names>J.&#x20;P. S.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Comparative Study of Advanced Signal Processing Techniques for Islanding Detection in a Hybrid Distributed Generation System</article-title>. <source>IEEE Trans. Sustain. Energ.</source> <volume>6</volume> (<issue>1</issue>), <fpage>122</fpage>&#x2013;<lpage>131</lpage>. <pub-id pub-id-type="doi">10.1109/tste.2014.2362797</pub-id> </citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Feature Learning for Stacked ELM via Low-Rank Matrix Factorization</article-title>. <source>Neurocomputing</source> <volume>448</volume>, <fpage>82</fpage>&#x2013;<lpage>93</lpage>. <pub-id pub-id-type="doi">10.1016/j.neucom.2021.03.110</pub-id> </citation>
</ref>
<ref id="B19">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Kusiak</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>He</surname>
<given-names>Y.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Modeling Wind-Turbine Power Curve: A Data Partitioning and Mining Approach</article-title>. <source>Renew. Energ.</source> <volume>102</volume>, <fpage>1</fpage>&#x2013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1016/j.renene.2016.10.032</pub-id> </citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Zha</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Qin</surname>
<given-names>L.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>A Combined Multivariate Model for Wind Power Prediction</article-title>. <source>Energ. Convers. Manag.</source> <volume>144</volume>, <fpage>361</fpage>&#x2013;<lpage>373</lpage>. <pub-id pub-id-type="doi">10.1016/j.enconman.2017.04.077</pub-id> </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Zha</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Qin</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Kusiak</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Optimisation of Time Window Size for Wind Power Ramps Prediction</article-title>. <source>IET Renew. Power Generation</source> <volume>11</volume> (<issue>8</issue>), <fpage>1270</fpage>&#x2013;<lpage>1277</lpage>. <pub-id pub-id-type="doi">10.1049/iet-rpg.2016.0341</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sevlian</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Rajagopal</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Detection and Statistics of Wind Power Ramps</article-title>. <source>IEEE Trans. Power Syst.</source> <volume>28</volume>, <fpage>3610</fpage>&#x2013;<lpage>3620</lpage>. <pub-id pub-id-type="doi">10.1109/tpwrs.2013.2266378</pub-id> </citation>
</ref>
<ref id="B23">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Shen</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Yang</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Zhuang</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Sample-Based Neural Approximation Approach for Probabilistic Constrained Programs</article-title>. <source>IEEE Trans. Neural Netw. Learn. Syst.</source>, <fpage>1</fpage>&#x2013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1109/TNNLS.2021.3102323</pub-id> </citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Singh</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Tewari</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2015</year>). <article-title>Classification of Power Quality Disturbances Using Wavelet Transform and Neural Network</article-title>. <source>Int. J.&#x20;Eng. Res. Tech.</source> <volume>4</volume> (<issue>05</issue>), <fpage>1423</fpage>. <pub-id pub-id-type="doi">10.17577/ijertv4is051331</pub-id> </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tang</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Zhao</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Two-phase Deep Learning Model for Short-Term Wind Direction Forecasting</article-title>. <source>Renew. Energ.</source> <volume>173</volume>, <fpage>1005</fpage>&#x2013;<lpage>1016</lpage>. <pub-id pub-id-type="doi">10.1016/j.renene.2021.04.041</pub-id> </citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tang</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Zhao</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Hybrid Ensemble Framework for Short-Term Wind Speed Forecasting</article-title>. <source>IEEE Access</source> <volume>8</volume>, <fpage>45271</fpage>&#x2013;<lpage>45291</lpage>. <pub-id pub-id-type="doi">10.1109/access.2020.2978169</pub-id> </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Zhang</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Long</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Xu</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Wind Turbine Gearbox Failure Identification with Deep Neural Networks</article-title>. <source>IEEE Trans. Ind. Inf.</source> <volume>13</volume> (<issue>3</issue>), <fpage>1360</fpage>&#x2013;<lpage>1368</lpage>. <pub-id pub-id-type="doi">10.1109/tii.2016.2607179</pub-id> </citation>
</ref>
<ref id="B28">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Z.</given-names>
</name>
<name>
<surname>Wang</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Liu</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Feng</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Uncertainty Estimation of Wind Power Prediction Result Based on Wind Process Method</article-title>. <source>Power Syst. Tech.</source> <volume>37</volume> (<issue>1</issue>), <fpage>242</fpage>&#x2013;<lpage>247</lpage>. </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Xiong</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Zha</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Qin</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Xia</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Research on Wind Power Ramp Events Prediction Based on Strongly Convective Weather Classification</article-title>. <source>IET Renew. Power Generation</source> <volume>11</volume> (<issue>8</issue>), <fpage>1278</fpage>&#x2013;<lpage>1285</lpage>. <pub-id pub-id-type="doi">10.1049/iet-rpg.2016.0516</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zha</surname>
<given-names>X.</given-names>
</name>
<name>
<surname>Ouyang</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Qin</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Xiong</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Huang</surname>
<given-names>H.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Selection of Time Window for Wind Power Ramp Prediction Based on Risk Model</article-title>. <source>Energ. Convers. Manag.</source> <volume>126</volume>, <fpage>748</fpage>&#x2013;<lpage>758</lpage>. <pub-id pub-id-type="doi">10.1016/j.enconman.2016.08.064</pub-id> </citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zheng</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Kusiak</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Prediction of Wind Farm Power Ramp Rates: A Data-Mining Approach</article-title>. <source>J.&#x20;solar Energ. Eng.</source> <volume>131</volume> (<issue>3</issue>), <fpage>031011</fpage>. <pub-id pub-id-type="doi">10.1115/1.3142727</pub-id> </citation>
</ref>
</ref-list>
</back>
</article>