This notebook provides details of how to grow Random Forests for phonetic data. This is not exclusive to phonetic data and can be used for any other type of data.

We will start by looking at the basics of predictive modelling, by looking at logistic regression as a classification tool and use some notions from the Signal Detection Theory (accuracy, sensitivity, specificity, recall, dprime, AUC). We then look at some issues with logistic regression related to multicollinearity. We introduce then decision trees to understand how they work, before attempting to replicate how Random Forests work. We then grow our first Random Forests and try to capture as much information as possible from it. At the end, we look at the approach advocated by tidymodels. At the end of the session, participants will be able to grow a Random Forest based on their own data.

2 Declare parallel computing

R is a powerful software. It is designed by default to only use one core on your machine. As you know, any laptop/computer comes with at least two cores (if not more). Mine has 4 physical cores with multihtreading (i.e., a total of 8 logical cores). If I am to run a code that requires heavy computations, I will never ever use one core (as it will take ages to run). This is where the additional power of R is needed.

We can use any parallel computing package. I use the doFuture package as it is one of the best backend parallel computing packages. I am declaring parallel computing below using one core only, but on your machine, you can use all cores

Number of cores available for model calculations set to 2.
[1] 2
Socket cluster with 2 nodes where 2 nodes are on host ‘localhost’ (R version 4.0.3 (2020-10-10), platform x86_64-w64-mingw32)

3 Introduction

The majority of research in phonetics and linguistics looks at traditional statistical techniques to evaluate group differences, using either frequentist or Bayesian frameworks. What is important in these frameworks is to assess whether a particular outcome can be explained by the potential differences that exist in a predictor. For example, we may want to examine if the differences observed in F2 frequency at the vowel midpoint can be explained by place of articulation, or age or gender. For this we use a linear regression (with or without mixed effects modelling) with the following formula: lm(F2 ~ place + age + gender).

This approach can potentially explain the differences associated with the predictors, i.e., we evaluate their influence on the outcome. But let’s ask the following question: can the observed differences on F2 frequency at the vowel midpoint be predictive of group differences associated with gender? Let’s put it differently: can we predict gender differences based on F2 frequencies? What would happen in the future? This is where predictive modelling comes to the rescue.

Predictive modelling is a statistical technique that uses either traditional or machine learning approaches to evaluate group difference and how they inform group separation. They can be used to predict changes either on the current data or in the future. If you build a predictive model based on pre-existing data, you can use the model’s predictions to:

  1. Validate the results on the current set
  2. Predict results on new ranges (e.g., if you have results on age group 30-50, in theory, you could predict the patterns for age 20 or 70)
  3. Predict results on new data, either on the testing set or any new data you obtain in the future.

To understand this further, we will start with a simple Generalised Linear Model predicting a perception experiment on grammaticality judgement, before moving to Decision Trees and Random Forests.

4 Generalised Linear Model

Here we will look at an example when the outcome is binary. This simulated data is structured as follows. We asked one participant to listen to 165 sentences, and to judge whether these are “grammatical” or “ungrammatical”. There were 105 sentences that were “grammatical” and 60 “ungrammatical”. This fictitious example can apply in any other situation. Let’s think Geography: 165 lands: 105 “flat” and 60 “non-flat”, etc. This applies to any case where you need to “categorise” the outcome into two groups.

4.1 Load and summaries

Let’s load in the data and do some basic summaries


-- Column specification ----------------------------------------------
cols(
  grammaticality = col_character(),
  response = col_character()
)
spec_tbl_df [165 x 2] (S3: spec_tbl_df/tbl_df/tbl/data.frame)
 $ grammaticality: chr [1:165] "grammatical" "grammatical" "grammatical" "grammatical" ...
 $ response      : chr [1:165] "yes" "yes" "yes" "yes" ...
 - attr(*, "spec")=
  .. cols(
  ..   grammaticality = col_character(),
  ..   response = col_character()
  .. )

4.2 Normal GLM

Let’s run a first GLM (Generalised Linear Model). A GLM uses a special family “binomial” as it assumes the outcome has a binomial distribution. In general, results from a Logistic Regression are close to what we get from SDT (see above).

To run the results, we will change the reference level for both response and grammaticality. The basic assumption about GLM is that we start with our reference level being the “no” responses to the “ungrammatical” category. Any changes to this reference will be seen in the coefficients as “yes” responses to the “grammatical” category.

4.2.1 Model estimation and results

The results below show the logodds for our model.

               response
grammaticality   no yes
  ungrammatical  50  10
  grammatical     5 100

Call:
glm(formula = response ~ grammaticality, family = binomial, data = .)

Deviance Residuals: 
    Min       1Q   Median       3Q      Max  
-2.4676  -0.6039   0.3124   0.3124   1.8930  

Coefficients:
                          Estimate Std. Error z value Pr(>|z|)    
(Intercept)                -1.6094     0.3464  -4.646 3.38e-06 ***
grammaticalitygrammatical   4.6052     0.5744   8.017 1.08e-15 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 210.050  on 164  degrees of freedom
Residual deviance:  94.271  on 163  degrees of freedom
AIC: 98.271

Number of Fisher Scoring iterations: 5

The results show that for one unit increase in the response (i.e., from no to yes), the logodds of being “grammatical” is increased by 4.6051702 (the intercept shows that when the response is “no”, the logodds are -1.6094379). The actual logodds for the response “yes” to grammatical is 2.9957323

4.2.2 LogOdds to proportions

If you want to talk about the percentage “accuracy” of our model, then we can transform our loggodds into proportions. This shows that the proportion of “grammatical” receiving a “yes” response increases by 95%

[1] 0.1666667
[1] 0.952381

4.3 Accuracy and Signal Detection Theory

4.3.1 Rationale

We are generally interested in performance, i.e., whether the we have “accurately” categorised the outcome or not and at the same time want to evaluate our biases in responses. When deciding on categories, we are usually biased in our selection.

Let’s ask the question: How many of you have a Mac laptop and how many a Windows laptop? For those with a Mac, what was the main reason for choosing it? Are you biased in anyway by your decision?

If we go back to our grammatical example above, we want to evaluate if the participant was biased in anyway while responding. To correct for these biases, we use some variants from Signal Detection Theory to obtain the true estimates without being influenced by the biases.

4.3.2 Running stats

Let’s do some stats on this

Yes No Total
Grammatical (Yes Actual) TP = 100 FN = 5 (Yes Actual) 105
Ungrammatical (No Actual) FP = 10 TN = 50 (No Actual) 60
Total (Yes Response) 110 (No Response) 55 165

TP = True Positive (Hit); FP = False Positive; FN = False Negative; TN = True Negative

[1] 100
[1] 5
[1] 10
[1] 50
[1] 165

4.3.2.1 Accuracy rate

Accuracy is simply the sum of true positives and true negatives divided by the total.

[1] 0.9090909

4.3.2.2 Error rate

The error rate can be computed as 1-accuracy or sum of false positives and false negatives divided by the total.

[1] 0.09090909

4.3.2.3 Specificity

Let us ask the following question: When the stimulus = yes, how many times the response = yes?

Here we quantify the true positive rate or specificity.

[1] 0.952381

4.3.2.4 False positive rate

Let us ask the following question: When the stimulus = no, how many times the response = yes?

[1] 0.1666667

4.3.2.5 Sensitivity

Sensitivity quantify the rejection rate and evaluates the sensitivity of the mode.

Let us ask the following question: When the stimulus = no, how many times the response = no?

[1] 0.8333333

4.3.2.6 Precision

Let us ask the following question: When the subject responds yes, how many times is (s)he correct?

[1] 0.9090909

4.3.2.7 DPrime and other SDT metrics

We use the library psycho to obtain SDT metrics.

One of the most important metrics is dprime. This is usually used in perception experiments as it allows to take into account both sensitivity and specificity. This means, it allows to correct for biases in estimation.

The various metrics computed are:

  1. dprime or the sensitivity index. Between -6 to +6. positive = accurate detection; +6 = maximum detection; 0 no detection; negative = more noise (i.e., “no” responses) in the data
  2. beta or the bias criterion. Between 0-1: lower = increase in “yes” responses
  3. Aprime or estimate of discriminability. Between 0-1: 1 = good discrimination; 0 is at chance
  4. bppd or the “b prime prime d”. Between -1 and 1: 0 = no bias, negative = tendency to respond “yes”, positive = tendency to respond “no”)
  5. c or the index of bias. equals to SD.

For more details, see link

From our perspective here, the most important is d-prime (and the other sespetivity/specificity metrics). This is modelling the difference between the rate of “True Positive” responses and “False Positive” responses in standard unit (or z-scores). The formula can be written as:

d' (d prime) = Z(True Positive Rate) - Z(False Positive Rate)

$dprime
[1] 2.635813

$beta
[1] 0.3970026

$aprime
[1] 0.9419643

$bppd
[1] -0.5076923

$c
[1] -0.3504848

4.3.3 GLM and d prime

The values obtained here match those obtained from SDT. For d prime, the difference stems from the use of the logit variant of the Binomial family. By using a probit variant, one obtains the same values (see here for more details). A probit variant models the z-score differences in the outcome and is evaluated in change in 1-standard unit. This is modelling the change from “ungrammatical” “no” responses into “grammatical” “yes” responses in z-scores. The same conceptual underpinnings of d-prime from Signal Detection Theory.

[1] 2.635813
grammaticalityungrammatical 
                   2.635813 

The logit variant of the GLM reports the coefficients for the True Positive Rate or Specificity; the probit variant reports on dprime, or the difference between the True Positive responses and the False Positive responses in standard units.

4.3.4 GLM as a classification tool

The code below demonstrates the links between our GLM model and what we had obtained above from SDT. The predictions’ table shows that our GLM was successful at obtaining prediction that are identical to our initial data setup. Look at the table here and the table above. Once we have created our table of outcome, we can compute percent correct, the specificity, the sensitivity, etc. This yields the actual value with the SD that is related to variations in responses.

     pred.gramm
      grammatical ungrammatical
  yes         100            10
  no            5            50
Setting levels: control = grammatical, case = ungrammatical
Setting direction: controls < cases

Call:
roc.default(response = grammatical$grammaticality, predictor = pred.gramm)

Data: pred.gramm in 105 controls (grammatical$grammaticality grammatical) < 60 cases (grammatical$grammaticality ungrammatical).
Area under the curve: 1

If you look at the results from SDT above, these results are the same as the following

Accuracy: (TP+TN)/Total (0.9090909)

True Positive Rate (or Specificity) TP/(TP+FN) (0.952381)

True Negative Rate (or Sensitivity) TN/(FP+TN) (0.8333333)

The Area Under the Curve (AUC) is usually used to assess the model’s performance. As you see, we use the sensitivity on the y-axis and the inverse of specificity (1-specificity) on the x-axis. The AUC for this data is 1, i.e., perfect predictions and if you look at the AUC plot, it shows a perfect accuracy and detection. This is usually rare but can be obtained. Recall that this is a made-up dataset for demonstration only!

Now lets continue with a real dataset.

4.4 Issues with GLM

Let’s look at a new dataset that comes from phonetic research. This dataset is from my current work on the phonetic basis of the guttural natural class in Levantine Arabic. Acoustic analyses were conducted on multiple portions of the VCV sequence, and we report here the averaged results on the first half of V2. Acoustic metrics were obtained via VoiceSauce: various acoustic metrics of supralaryngeal (bark difference) and laryngeal (voice quality via amplitude harmonic differences, noise, energy) were obtained. A total of 23 different acoustic metrics were obtained from 10 participants. Here, we use the data from the first two participants for demonstration purposes (one male and one female). The grouping factor of interest is context with two levels: guttural vs non-guttural. Gutturals include uvular, pharyngealised and pharyngeal consonants; non-gutturals include coronal plain, velar and glottal consonants.

The aim of the study was to evaluate whether the combination of the acoustic metrics provides support for a difference between the two classes of gutturals vs non-gutturals.

4.4.1 Load and summarise


-- Column specification ----------------------------------------------
cols(
  .default = col_double(),
  context = col_character()
)
i Use `spec()` for the full column specifications.

4.4.2 First predictive model

4.4.2.1 Linear model

Let’s start by a simple linear model to evaluate relationship between a particular measure Z2-Z1 and the context.


Call:
lm(formula = Z2mnZ1 ~ context, data = .)

Residuals:
   Min     1Q Median     3Q    Max 
-4.301 -2.185 -1.383  3.507  4.994 

Coefficients:
                Estimate Std. Error t value Pr(>|t|)    
(Intercept)       6.2964     0.1903  33.094  < 2e-16 ***
contextGuttural  -0.9849     0.2843  -3.464  0.00059 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

Residual standard error: 2.835 on 400 degrees of freedom
Multiple R-squared:  0.02912,   Adjusted R-squared:  0.02669 
F-statistic:    12 on 1 and 400 DF,  p-value: 0.0005902

What this result is telling us is that there is a statistically significant decrease in Z2-Z1 in the guttural class when compared with the non-guttural (ignoring the fact that we need mixed modelling to evaluate the results). Now let’s ask the question: with this linear model, can you predict percentage separation between the two classes? Are you able to tell if the differences observed between the two classes are meaningful? This is where we need to change our way of looking at the data. Let’s look at GLM as a classification tool as above

4.4.2.2 GLM as a classification tool

4.4.2.2.1 Model specification

We run a GLM with context as our outcome, and Z2-Z1 as our predictor. We want to evaluate whether the two classes can be separated when using the acoustic metric Z2-Z1. Context has two levels, and this will be considered as a binomial distribution.


Call:
glm(formula = context ~ Z2mnZ1, family = binomial, data = .)

Deviance Residuals: 
    Min       1Q   Median       3Q      Max  
-1.2879  -1.1358  -0.8703   1.1538   1.4998  

Coefficients:
            Estimate Std. Error z value Pr(>|z|)    
(Intercept)  0.50112    0.23036   2.175 0.029605 *  
Z2mnZ1      -0.12281    0.03621  -3.391 0.000696 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 552.89  on 401  degrees of freedom
Residual deviance: 541.01  on 400  degrees of freedom
AIC: 545.01

Number of Fisher Scoring iterations: 4
4.4.2.2.2 Plogis

The result above shows that when moving from the non-guttural (intercept), a unit increase (i.e., guttural) yields a statistically significant decrease in the logodds associated with Z2-Z1. We can evaluate this further from a classification point of view, using plogis.

[1] 0.622722
[1] 0.5934644

This shows that Z2-Z1 is able to explain the difference in the guttural class with an accuracy of 59%. Let’s continue with this model further.

4.4.2.2.3 Model predictions

As above, we obtain predictions from the model. Because we are using a numeric predictor, we need to assign a threshold for the predict function. The threshold can be thought of as telling the predict function to assign any predictions lower than 50% to one group, and any higher to another.

               
pred.glm.Z2mnZ1 Non-Guttural Guttural
   Non-Guttural          167       75
   Guttural               55      105
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = dfPharV2$context, predictor = as.numeric(pred.glm.Z2mnZ1))

Data: as.numeric(pred.glm.Z2mnZ1) in 222 controls (dfPharV2$context Non-Guttural) < 180 cases (dfPharV2$context Guttural).
Area under the curve: 0.6678

The model above was able to explain the difference between the two classes with an accuracy of 67.7%. It has a slightly low specificity (0.58) to detect gutturals, but a flighty high sensitivity (0.75) to reject the non-gutturals. Looking at the confusion matrix, we observe that both groups were relatively accurately identified, but we have relatively large errors (or confusions). The AUC is at 0.67, which is not too high.

Let’s continue with GLM to evaluate it further. We start by running a correlation test to evaluate issues with GLM.

4.4.3 Correlation tests

The correlation plot above shows which predictors are correlated with each other (positively or negatively). They are organised by hierarchical clustering that identifies clusters of predictors correlated with each other.

4.4.3.1 Correlation tests

Below, we look at two predictors that are correlated with each other: Z3-Z2 (F3-F2 in Bark) and A2*-A3* (normalised amplitude differences between harmonics closest to F2 and F3). The results of the correlation test shows the two predictors to negatively correlate with each other at a rate of -0.87.


    Pearson's product-moment correlation

data:  dfPharV2$Z3mnZ2 and dfPharV2$A2mnA3
t = -35.864, df = 400, p-value < 2.2e-16
alternative hypothesis: true correlation is not equal to 0
95 percent confidence interval:
 -0.8947506 -0.8480066
sample estimates:
       cor 
-0.8733751 

4.4.3.2 Plots to visualise the data

As we see from the plot, Z3-Z2 is higher in the guttural, whereas A2*-A3* is lower.

4.4.3.3 GLM on correlated data

Let’s run a logistic regression as a classification tool to predict the context as a function of each predictor separately and then combined.


Call:
glm(formula = context ~ Z3mnZ2, family = binomial, data = .)

Deviance Residuals: 
   Min      1Q  Median      3Q     Max  
-1.405  -1.061  -0.872   1.180   1.559  

Coefficients:
            Estimate Std. Error z value Pr(>|z|)    
(Intercept) -0.99451    0.23061  -4.313 1.61e-05 ***
Z3mnZ2       0.17440    0.04553   3.831 0.000128 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 552.89  on 401  degrees of freedom
Residual deviance: 537.74  on 400  degrees of freedom
AIC: 541.74

Number of Fisher Scoring iterations: 4

Call:
glm(formula = context ~ A2mnA3, family = binomial, data = .)

Deviance Residuals: 
    Min       1Q   Median       3Q      Max  
-1.5858  -1.0416  -0.6598   1.0684   2.0105  

Coefficients:
            Estimate Std. Error z value Pr(>|z|)    
(Intercept) -0.98961    0.16632  -5.950 2.68e-09 ***
A2mnA3      -0.06973    0.01122  -6.215 5.12e-10 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 552.89  on 401  degrees of freedom
Residual deviance: 508.51  on 400  degrees of freedom
AIC: 512.51

Number of Fisher Scoring iterations: 4

Call:
glm(formula = context ~ Z3mnZ2 + A2mnA3, family = binomial, data = .)

Deviance Residuals: 
    Min       1Q   Median       3Q      Max  
-1.6782  -1.0231  -0.6124   1.0639   2.1936  

Coefficients:
            Estimate Std. Error z value Pr(>|z|)    
(Intercept) -0.10996    0.27830  -0.395 0.692754    
Z3mnZ2      -0.39266    0.10201  -3.849 0.000118 ***
A2mnA3      -0.14930    0.02418  -6.175 6.61e-10 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

(Dispersion parameter for binomial family taken to be 1)

    Null deviance: 552.89  on 401  degrees of freedom
Residual deviance: 492.50  on 399  degrees of freedom
AIC: 498.5

Number of Fisher Scoring iterations: 4

When looking at the three models above, it is clear that the logodd value for Z3-Z2 is positive, whereas it is negative for A2*-A3*. When adding the two predictors together, there is clear suppression: the coefficients for both predictors are now negative. The relatively high correlation between the predictors affected the coefficients and changed the direction of the slope; collinearity is harmful for any regression analysis.

In the following, we introduce decision trees followed by Random Forest as a way to deal with collinearity and to make sense of multivariate predictors.

5 Decision Trees

Decision trees are a statistical tool that uses the combination of predictors to identify patterns in the data and provides classification accuracy for the model.

The decision tree used is based on conditional inference trees that looks at each predictor and splits the data into multiple nodes (branches) through recursive partitioning in a tree-structured regression model. Each node is also split into leaves (difference between levels of outcome).

Decision trees via ctree does the following:

  1. Test global null hypothesis of independence between predictors and outcome.
  2. Select the predictor with the strongest association with the outcome measured based on a multiplicity adjusted p-values with Bonferroni correction
  3. Implement a binary split in the selected input variable.
  4. Recursively repeat steps 1), 2). and 3).

Let’s see this in an example using the same dataset. To understand what the decision tree is doing, we will dissect it, by creating one tree with one predictor and move to the next.

5.1 Individual trees

5.1.1 Tree 1


     Conditional inference tree with 4 terminal nodes

Response:  context 
Input:  Z2mnZ1 
Number of observations:  402 

1) Z2mnZ1 <= 9.551456; criterion = 0.999, statistic = 11.678
  2) Z2mnZ1 <= 6.779068; criterion = 1, statistic = 12.368
    3) Z2mnZ1 <= 4.004879; criterion = 1, statistic = 56.773
      4)*  weights = 157 
    3) Z2mnZ1 > 4.004879
      5)*  weights = 106 
  2) Z2mnZ1 > 6.779068
    6)*  weights = 64 
1) Z2mnZ1 > 9.551456
  7)*  weights = 75 

How to interpret this figure? Let’s look at mean values and a plot for this variable. This is the difference between F2 and F1 using the bark scale. Because gutturals are produced within the pharynx (regardless of where), the predictions is that a high F1 and a low F2 will be the acoustic correlates related to this constriction location. The closeness between these formants yields a lower Z2-Z1. Hence, the prediction is as follow: the smaller the difference, the more pharyngeal-like constriction these consonants have (all else being equal!). Let’s compute the mean/median and plot the difference between the two contexts.

The table above reports the mean and median of Z2-Z1 for both levels of context and the plots show the difference between the two. We have a total of 180 cases in the guttural, and 222 in the non-guttural. When considering the conditional inference tree output, various splits were obtained. The first is any value higher than 9.55 being assigned to the non-guttural class (around 98% of 75 cases) Then, with anything lower than 9.55, a second split was obtained. A threshold of 6.78: higher assigned to guttural (around 98% of 64 cases), lower, were split again with a threshold of 4 Bark. A third split was obtained: values lower of equal to 4 Bark are assigned to the guttural (around 70% of 157 cases) and values higher than 4 Barks assigned to the non-guttural (around 90% of 106 cases).

Dissecting the tree like this allows interpretation of the output. In this example, this is quite a complex case and ctree allowed to fine tune the different patterns seen with Now let’s look at the full dataset to make sense of the combination of predictors to the difference.

5.2 Model 1

5.2.1 Model specification


     Conditional inference tree with 8 terminal nodes

Response:  context 
Inputs:  CPP, Energy, H1A1c, H1A2c, H1A3c, H1H2c, H2H4c, H2KH5Kc, H42Kc, HNR05, HNR15, HNR25, HNR35, SHR, soe, Z1mnZ0, Z2mnZ1, Z3mnZ2, Z4mnZ3, F0Bark, A1mnA2, A1mnA3, A2mnA3 
Number of observations:  402 

1) A2mnA3 <= -13.78; criterion = 1, statistic = 42.329
  2) Z4mnZ3 <= 1.592125; criterion = 1, statistic = 40.991
    3) H2H4c <= -8.396333; criterion = 0.993, statistic = 13.141
      4)*  weights = 8 
    3) H2H4c > -8.396333
      5)*  weights = 100 
  2) Z4mnZ3 > 1.592125
    6) Energy <= 2.8295; criterion = 0.999, statistic = 16.923
      7)*  weights = 25 
    6) Energy > 2.8295
      8)*  weights = 10 
1) A2mnA3 > -13.78
  9) H1H2c <= 10.27167; criterion = 0.953, statistic = 9.458
    10) SHR <= 0.1566667; criterion = 1, statistic = 18.337
      11)*  weights = 99 
    10) SHR > 0.1566667
      12) H1H2c <= 0.7411667; criterion = 0.972, statistic = 10.449
        13)*  weights = 103 
      12) H1H2c > 0.7411667
        14)*  weights = 30 
  9) H1H2c > 10.27167
    15)*  weights = 27 

How to interpret this complex decision tree?

Let’s obtain the median value for each predictor grouped by context. Discuss some of the patterns.

We started with context as our outcome, and all 23 acoustic measures as predictors. A total of 8 terminal nodes were identified with multiple binary splits in their leaves, allowing separation of the two categories. Looking specifically at the output, we observe a few things.

The first node was based on A2*-A3*, detecting a difference between non-gutturals and gutturals. For the first binary split, a threshold of -13.78 Bark was used (mean non guttural = -7.86; mean guttural = -14.58), then for values lower of equal to this threshold, a second split was performed using Z4-Z3 (mean non guttural = 1.67; mean guttural = 1.43) with any value smaller and equal to 1.59, then another binary split using H2*-H4*, etc…

Once done, the ctree provides multiple binary splits into guttural or non-guttural.

Any possible issues/interesting patterns you can identify? Look at the interactions between predictors.

5.2.2 Predictions from the full model

Let’s obtain some predictions from the model and evaluate how successful it is in dealing with the data.

              
pred.ctree     Non-Guttural Guttural
  Non-Guttural          194       41
  Guttural               28      139
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = dfPharV2$context, predictor = as.numeric(pred.ctree))

Data: as.numeric(pred.ctree) in 222 controls (dfPharV2$context Non-Guttural) < 180 cases (dfPharV2$context Guttural).
Area under the curve: 0.823

This full model has a classification accuracy of 82.8%.This is not bad!! It has a relatively moderate specificity at 0.77 (at detecting the gutturals) but a high sensitivity at 0.87 (at detecting the non-gutturals). The ROC curve shows the relationship between the two with an AUC of 0.823

5.3 Up to you..

Try and fit two decision trees, the first on bark difference metrics and the second on voice quality metrics. Use the tidyverse approach to 1) select predictors and 2) to run ctree.

Answer below!!


     Conditional inference tree with 10 terminal nodes

Response:  context 
Inputs:  Z1mnZ0, Z2mnZ1, Z3mnZ2, Z4mnZ3 
Number of observations:  402 

1) Z4mnZ3 <= 1.799617; criterion = 1, statistic = 34.279
  2) Z2mnZ1 <= 9.551456; criterion = 1, statistic = 37.254
    3) Z4mnZ3 <= 1.391407; criterion = 1, statistic = 25.19
      4)*  weights = 95 
    3) Z4mnZ3 > 1.391407
      5) Z2mnZ1 <= 6.469292; criterion = 0.985, statistic = 8.367
        6) Z2mnZ1 <= 4.323492; criterion = 1, statistic = 16.776
          7)*  weights = 52 
        6) Z2mnZ1 > 4.323492
          8)*  weights = 24 
      5) Z2mnZ1 > 6.469292
        9)*  weights = 35 
  2) Z2mnZ1 > 9.551456
    10)*  weights = 69 
1) Z4mnZ3 > 1.799617
  11) Z3mnZ2 <= 2.89833; criterion = 0.97, statistic = 7.118
    12) Z3mnZ2 <= 1.594082; criterion = 0.958, statistic = 6.51
      13)*  weights = 7 
    12) Z3mnZ2 > 1.594082
      14)*  weights = 13 
  11) Z3mnZ2 > 2.89833
    15) Z2mnZ1 <= 3.624215; criterion = 1, statistic = 23.704
      16) Z1mnZ0 <= 2.972983; criterion = 0.996, statistic = 10.856
        17)*  weights = 16 
      16) Z1mnZ0 > 2.972983
        18)*  weights = 18 
    15) Z2mnZ1 > 3.624215
      19)*  weights = 73 

               
pred.ctree.Form Non-Guttural Guttural
   Non-Guttural          184        5
   Guttural               38      175
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = dfForm$context, predictor = as.numeric(pred.ctree.Form))

Data: as.numeric(pred.ctree.Form) in 222 controls (dfForm$context Non-Guttural) < 180 cases (dfForm$context Guttural).
Area under the curve: 0.9005


     Conditional inference tree with 8 terminal nodes

Response:  context 
Inputs:  CPP, Energy, H1A1c, H1A2c, H1A3c, H1H2c, H2H4c, H2KH5Kc, H42Kc, HNR05, HNR15, HNR25, HNR35, SHR, soe, F0Bark, A1mnA2, A1mnA3, A2mnA3 
Number of observations:  402 

1) A2mnA3 <= -13.78; criterion = 1, statistic = 42.329
  2) HNR35 <= 47.42933; criterion = 1, statistic = 30.104
    3) A1mnA3 <= -11.97567; criterion = 0.972, statistic = 10.108
      4)*  weights = 67 
    3) A1mnA3 > -11.97567
      5)*  weights = 12 
  2) HNR35 > 47.42933
    6) H1A3c <= 0.4188333; criterion = 0.999, statistic = 16.941
      7)*  weights = 43 
    6) H1A3c > 0.4188333
      8)*  weights = 21 
1) A2mnA3 > -13.78
  9) H1H2c <= 10.27167; criterion = 0.961, statistic = 9.458
    10) SHR <= 0.1566667; criterion = 1, statistic = 18.337
      11)*  weights = 99 
    10) SHR > 0.1566667
      12) H1H2c <= 0.7411667; criterion = 0.977, statistic = 10.449
        13)*  weights = 103 
      12) H1H2c > 0.7411667
        14)*  weights = 30 
  9) H1H2c > 10.27167
    15)*  weights = 27 

              
pred.ctree.VQ  Non-Guttural Guttural
  Non-Guttural          182       41
  Guttural               40      139
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = dfVQ$context, predictor = as.numeric(pred.ctree.VQ))

Data: as.numeric(pred.ctree.VQ) in 222 controls (dfVQ$context Non-Guttural) < 180 cases (dfVQ$context Guttural).
Area under the curve: 0.796

5.4 Random selection

One important issue is that the trees we grew above are biased. They are based on the full dataset, which means they are very likely to overfit the data. We did not add any random selection and we only grew one tree each time. If you think about it, is it possible that we obtained such results simply by chance?

What if we add some randomness in the process of creating a conditional inference tree?

We change a small option in ctree to allow for random selection of variables, to mimic what Random Forests will do. We use controls to specify mtry = 5, which is the rounded square root of number of predictors.

5.4.1 Model 2

              
pred.ctree1    Non-Guttural Guttural
  Non-Guttural          101       10
  Guttural              121      170
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = dfPharV2$context, predictor = as.numeric(pred.ctree1))

Data: as.numeric(pred.ctree1) in 222 controls (dfPharV2$context Non-Guttural) < 180 cases (dfPharV2$context Guttural).
Area under the curve: 0.6997

Can you compare results between you and discuss what is going on?

When adding one random selection process to our ctree, we allow it to obtain more robust predictions. We could even go further and grow multiple small trees with a portion of datapoints (e.g., 100 rows, 200 rows). When doing these multiple random selections, you are growing multiple trees that are decorrelated from each other. These become independent trees and one can combine the results of these trees to come with clear predictions.

This is how Random Forests work. You would start from a dataset, then grow multiple trees, vary number of observations used (nrow), and number of predictors used (mtry), adjust branches, and depth of nodes and at the end, combine the results in a forest. You can also run permutation tests to evaluate contributions of each predictor to the outcome. This is the beauty of Random Forests. They do all of these steps automatically at once for you!

6 Random Forests

As their name indicate, a Random Forest is a forest of trees implemented through bagging ensemble algorithms. Each tree has multiple branches (nodes), and will provide predictions based on recursive partitioning of the data. Then using the predictions from the multiple grown trees, Random Forests will create averaged predictions and come up with prediction accuracy, etc.

There are multiple packages that one can use to grow Random Forests:

  1. randomForest: The original implementation of Random Forests.
  2. party and partykit: using conditional inference trees as base learners
  3. ranger: a reimplementation of Random Forests; faster and more flexible than original implementation

The first implementation of Random Forests is widely used in research. One of the issues in this first implementation is that it favoured specific types of predictors (e.g., categorical predictors, predictors with multiple cut-offs, etc). Random Forests grown via Conditional Inference Trees as implemented in party guard against this bias, but they are computationally demanding. Random Forests grown via permutation tests as implemented in ranger speed up the computations and can mimic the unbiased selection process.

6.1 Party

Random Forests grown via conditional inference trees, are different from the original implementation. They offer an unbiased selection process that guards against overfitting of the data. There are various points we need to consider in growing the forest, including number of trees and predictors to use each time. Let us run our first Random Forest via conditional inference trees. To make sure the code runs as fast as it can, we use a very low number of trees: only 100 It is well known that the more trees you grow, the more confidence you have in the results, as model estimation will be more stable. In this example, I would easily go with 500 trees..

6.1.1 Model specification

To grow the forest, we use the function cforest. We use all of the dataset for the moment. We need to specify a few options within controls:

  1. ntree = 100 = number of trees to grow. Default = 500.
  2. mtry = round(sqrt(23)): number of predictors to use each time. Default is 5, but specifying it is advised to account for the structure of the data

By default, cforest_unbiased has two additional important options that are used for an unbiased selection process. WARNING: you should not change these unless you know what you are doing. Also, by default, the data are split into a training and a testing set. The training is equal to 2/3s of the data; the testing is 1/3.

  1. replace = FALSE = Use subsampling with or without replacement. Default is FALSE, i.e., use subsets of the data without replacing these.
  2. fraction = 0.632 = Use 63.2% of the data in each split.

6.1.2 Predictions

To obtain predictions from the model, we use the predict function and add OOB = TRUE. This uses the out-of-bag sample (i.e., 1/3 of the data).

              
pred.cforest   Non-Guttural Guttural
  Non-Guttural          204       40
  Guttural               18      140
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = dfPharV2$context, predictor = as.numeric(pred.cforest))

Data: as.numeric(pred.cforest) in 222 controls (dfPharV2$context Non-Guttural) < 180 cases (dfPharV2$context Guttural).
Area under the curve: 0.8483

Compared with the 82.8% classification accuracy we obtained using ctree using our full dataset above (model 1), here we obtain 85.5% with an 2.7% increase. Compared with the 67.4% from model 2 from ctree with random selection of predictors, we have an 18.1% increase in classification accuracy!

We could test whether there is statistically significant difference between our ctree and cforest models. Using the ROC curves, the roc.test conducts a non-parametric Z test of significance on the correlated ROC curves. The results show a statistically significant improvement using the cforest model. This is normal because we are growing 100 different trees, with random selection of both predictors and samples and provide an averaged prediction.


    DeLong's test for two correlated ROC curves

data:  roc.ctree and roc.cforest
Z = -1.1556, p-value = 0.2478
alternative hypothesis: true difference in AUC is not equal to 0
sample estimates:
AUC of roc1 AUC of roc2 
  0.8230480   0.8483483 

    DeLong's test for two correlated ROC curves

data:  roc.ctree1 and roc.cforest
Z = -6.3835, p-value = 1.731e-10
alternative hypothesis: true difference in AUC is not equal to 0
sample estimates:
AUC of roc1 AUC of roc2 
  0.6996997   0.8483483 

6.1.3 Variable Importance Scores

One important feature in ctree was to show which predictor was used first is splitting the data, which was then followed by the other predictors. We use a similar functionality with cforest to obtain variable importance scores to pinpoint strong and weak predictors.

There are two ways to obtain this:

  1. Simple permutation tests (conditional = FALSE)
  2. Conditional permutation tests (conditional = TRUE)

The former is generally comparable across packages and provides a normal permutation test; the latter runs a permutation test on a grid defined by the correlation matrix and corrects for possible collinearity. This is similar to a regression analysis, but looks at both main effects and interactions.

You could use the normal varimp as implemented in party. This uses mean decrease in accuracy scores. We will use variable importance scores via an AUC based permutation tests as this uses both accuracy and errors in the model, using varImpAUC from the varImp package.

DANGER ZONE: using conditional permutation test requires a lot of RAMs, unless you have access to a cluster, and/or a lot of RAMs, do not attempt running it. We will run the non-conditional version here for demonstration.

The Variable Importance Scores via non-conditional permutation tests showed that A2*-A3* (i.e., energy in mid-high frequencies around F2 and F3) is the most important variable at explaining the difference between gutturals and non-gutturals, followed by Z4-Z3 (pharyngeal constriction), H1*-A3* (energy in mid-high frequency component), Z2-Z1 (degree of compactness), Z3-Z2 (spectral divergence), H1*-A2 (energy in mid frequency component) and Z1-Z0 (degree of openness). All other predictors contribute to the contrast but to varying degrees (from H1*-H2* to H1*-A1*). The last 5 predictors are the least important and and the CPP has a 0 mean decrease in accuracy and can even be ignored.

6.1.4 Conclusion

The party package is powerful at growing Random Forests via conditional Inference trees, but is computationally prohibitive when increasing number of trees and using conditional permutation tests of variable importance scores. We look next at the package ranger due to its speed in computation and flexibility.

6.2 Ranger

The ranger package proposes a reimplementation of the original Random Forests algorithms, written in C++ and allows for parallel computing. It offers more flexibility in terms of model specification.

6.2.1 Model specification

In the model below specification below, there are already a few options we are familiar with, with additional ones described below:

  1. num.tree = Number of trees to grow. We use the default value
  2. mtry = Number of predictors to use. Default = floor(sqrt(Variables)). For compatibility with party, we use round(sqrt(23))
  3. replace = FALSE = Use subsampling with or without replacement. Default replace = TRUE, i.e., is with replacement.
  4. sample.fraction = 0.632 = Use 63.2% of the data in each split. Default is full dataset, i.e., sample.fraction = 1
  5. importance = "permutation" = Compute variable importance scores via permutation tests
  6. scale.permutation.importance = FALSE = whether to scale variable importance scores to be out of 100%. Default is TRUE. This is likely to introduce biases in variable importance estimation.
  7. splitrule = "extratrees" = rule used for splitting trees.
  8. num.threads = allow for parallel computing. Here we only specify 1 thread, but can use all thread on your computer (or cluster).

We use options 2-7 to make sure we have an unbiased selection process with ranger. You can try on your own running the model below by using the defaults to see how the rate of classification increases more, but with the caveat that it has a biased selection process.

Ranger result

Call:
 ranger(context ~ ., data = ., num.trees = 500, mtry = round(sqrt(23)),      replace = FALSE, sample.fraction = 0.632, importance = "permutation",      scale.permutation.importance = FALSE, splitrule = "extratrees",      num.threads = 1) 

Type:                             Classification 
Number of trees:                  500 
Sample size:                      402 
Number of independent variables:  23 
Mtry:                             5 
Target node size:                 1 
Variable importance mode:         permutation 
Splitrule:                        extratrees 
Number of random splits:          1 
OOB prediction error:             8.21 % 

Results of our Random Forest shows an OOB (Out-Of-Bag) error rate of 8.2%, i.e., an accuracy of 91.8%.

6.2.2 Going further

Unfortunately, when growing a tree with ranger, we cannot use predictions from the OOB sample as there is no comparable options to do so on the predictions. We need to hard-code this. We split the data into a training and a testing sets. The training will be on 2/3s of the data; the testing is on the remaining 1/3.

6.2.2.2 Model specification

We use the same model specification as above, except from using the training set and saving the forest (with write.forest = TRUE).

Ranger result

Call:
 ranger(context ~ ., data = ., num.trees = 500, mtry = round(sqrt(23)),      replace = FALSE, sample.fraction = 0.632, importance = "permutation",      scale.permutation.importance = FALSE, splitrule = "extratrees",      num.threads = 1, write.forest = TRUE) 

Type:                             Classification 
Number of trees:                  500 
Sample size:                      268 
Number of independent variables:  23 
Mtry:                             5 
Target node size:                 1 
Variable importance mode:         permutation 
Splitrule:                        extratrees 
Number of random splits:          1 
OOB prediction error:             9.33 % 

With the training set, we have an OOB error rate of 9.3%; i.e., an accuracy rate of 90.7%.

6.2.2.3 Predictions

For the predictions, we use the testing set as a validation set. This is to be considered as a true reflection of the model. This is unseen data not used in the training set.

              
               Non-Guttural Guttural
  Non-Guttural           70       15
  Guttural                3       46
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = gutt.test$context, predictor = as.numeric(pred.ranger2$predictions))

Data: as.numeric(pred.ranger2$predictions) in 73 controls (gutt.test$context Non-Guttural) < 61 cases (gutt.test$context Guttural).
Area under the curve: 0.8565

The classification rate based on the testing set is 86.6%. This is comparable to the one we obtained with cforest. The changes in the settings allow for similarities in the predictions obtained from both party and ranger.

6.2.2.4 Variable Importance Scores

6.2.2.4.1 Default

For the variable importance scores, we obtain them from either the training set or the full model above.

There are similarities between cforest and ranger, with minor differences. Z2-Z1 is the best predictor at explaining the differences between gutturals and non-gutturals with ranger followed by Z3-Z2 and then A2*-A3*, (reverse with cforest!). The order of the additional predictors is sightly different between the two models. This is expected as the cforest model only used 100 trees, whereas the ranger model used 500 trees.

A clear difference between the packages party and ranger is that the former allows for conditional permutation tests for variable importance scores; this is absent from ranger. However, there is a debate in the literature on whether correlated data are harmful within Random Forests. It is clear that how Random Forests work, i.e., the randomness in the selection process in number of data points, predictors, splitting rules, etc. allow the trees to be decorrelated from each other. Hence, the conditional permutation tests may not be required. But what they offer is to condition variable importance scores on each other (based on correlation tests) to mimic what a multiple regression analysis does (but without suffering from suppression!). Strong predictors will show major contribution, while weak ones will be squashed giving them extremely low (or even negative) scores. Within ranger, it is possible to evaluate this by estimating p values associated with each variable importance.We use the altman method. See documentation for more details.

DANGER ZONE: This requires heavy computations. Use with all cores on your machine or in the cluster. Recommendations are to use a minimum of 100 permutations or more, i.e., num.permutations = 100. Here, we only use 20 to show the output.

6.2.2.4.2 With p values
         importance     pvalue
CPP     0.002727273 0.14285714
Energy  0.015535354 0.04761905
H1A1c   0.014929293 0.04761905
H1A2c   0.029979798 0.04761905
H1A3c   0.035979798 0.04761905
H1H2c   0.014303030 0.04761905
H2H4c   0.010060606 0.04761905
H2KH5Kc 0.013434343 0.04761905
H42Kc   0.013434343 0.04761905
HNR05   0.007939394 0.04761905
HNR15   0.013838384 0.04761905
HNR25   0.013030303 0.04761905
HNR35   0.014222222 0.04761905
SHR     0.013313131 0.04761905
soe     0.008969697 0.04761905
Z1mnZ0  0.028505051 0.04761905
Z2mnZ1  0.066808081 0.04761905
Z3mnZ2  0.043232323 0.04761905
Z4mnZ3  0.039858586 0.04761905
F0Bark  0.009838384 0.04761905
A1mnA2  0.015070707 0.04761905
A1mnA3  0.027696970 0.04761905
A2mnA3  0.041313131 0.04761905

Of course, the output above shows variable p values. The lowest is at 0.048 for all predictors; one at 0.14 for CPP. Recall that CPP received the lowest variable importance score within ranger and cforest. If you increase permutations to 100 or 200, you will get more confidence in your results and can report the p values

6.3 Up to you!

Following what we have done above with decision trees, run a Random Forest either with party or ranger on formants or voice quality. Discuss with your peers the results and we can discuss any issues.. You need to 1) select variables and 2) run the code. Don’t forget, you can simply copy and paste the code, but it is best to try to recall the call functions.

Answer below!!

                 
pred.cforest.Form Non-Guttural Guttural
     Non-Guttural          201       22
     Guttural               21      158
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = dfForm$context, predictor = as.numeric(pred.cforest.Form))

Data: as.numeric(pred.cforest.Form) in 222 controls (dfForm$context Non-Guttural) < 180 cases (dfForm$context Guttural).
Area under the curve: 0.8916

               
pred.cforest.VQ Non-Guttural Guttural
   Non-Guttural          202       61
   Guttural               20      119
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = dfVQ$context, predictor = as.numeric(pred.cforest.VQ))

Data: as.numeric(pred.cforest.VQ) in 222 controls (dfVQ$context Non-Guttural) < 180 cases (dfVQ$context Guttural).
Area under the curve: 0.7855

              
               Non-Guttural Guttural
  Non-Guttural           69        7
  Guttural                4       54
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = gutt.test$context, predictor = as.numeric(pred.ranger.Form$predictions))

Data: as.numeric(pred.ranger.Form$predictions) in 73 controls (gutt.test$context Non-Guttural) < 61 cases (gutt.test$context Guttural).
Area under the curve: 0.9152

              
               Non-Guttural Guttural
  Non-Guttural           70       22
  Guttural                3       39
Setting levels: control = Non-Guttural, case = Guttural
Setting direction: controls < cases

Call:
roc.default(response = gutt.test$context, predictor = as.numeric(pred.ranger.VQ$predictions))

Data: as.numeric(pred.ranger.VQ$predictions) in 73 controls (gutt.test$context Non-Guttural) < 61 cases (gutt.test$context Guttural).
Area under the curve: 0.7991

In the next part, we look at the tidymodels and introduce their philosophy.

7 Random forests with Tidymodels

The tidymodels are a bundle of packages used to streamline and simplify the use of machine learning. The tidymodels are not restricted to Random Forests, and you can even use them to run simple linear models, logistic regressions, PCA, Random Forests, Deep Learning, etc.

The tidymodels’ philosophy is to separate data processing on the training and testing sets, and use of a workflow. Below, is an full example of how one can run Random Forests with via ranger using the tidymodels.

7.1 Training and testing sets

We start by creating a training and a testing set using the function initial_split. Using strata = context allows the model to split the data taking into account its structure and splits the data according to proportions of each group.

<Analysis/Assess/Total>
<270/132/402>

7.2 Set for cross-validation

We can (if we want to), create a 10-folds cross-validation on the training set. This allows to fine tune the training by obtaining the forest with the highest accuracy. This is a clear difference with ranger. While it is not impossible to hard code that, tidymodels simplify it for us!!

7.3 Model Specification

Within the model specification, we need to specify multiple options:

  1. A recipe: This is the recipe and is related to any data processing one wants to apply on the data.
  2. An engine: We need to specify the engine to use. Here we want to run a Random Forest.
  3. A tuning: Here we can tune our engine
  4. A workflow: here we specify the various steps of the workflow

7.3.1 Recipe

When defining the recipe, you need to think of the type of “transformations” you will apply to your data.

  1. Z-scoring is the first thing that comes to mind. When you z-score the data, you are allowing all strong and weak predictors to be considered equally by the model. This is important as some of our predictors have very large differences related to the levels of context and have different measurement scales. We could have applied it above, but we need to make sure to apply it separately on both training and testing sets (otherwise, our model suffers from data leakage)
  2. If you have any missing data, you can use central imputations to fill in missing data (random forests do not like missing data, though they can work with them).
  3. You can apply PCA on all your predictors to remove collinearity before running random forests. This is a great option to consider, but adds more complexity to your model. 4.Finally, if you have categorical predictors, you can transform them into dummy variables using step_dummy(): 1s and 2s for binary; or use one-hot-encoding step_dummy(predictor, one_hot = TRUE)

See documentations of tidymodels for what you can apply!!

Once we have prepared the recipe, we can bake it to see the changes applied to it.

7.3.3 Settings for tuning

If we want to tune the model, then uncomment the lines below. It is important to use an mtry that hovers around the round(sqrt(Variables)). If you use all available variables, then your forest is biased as it is able to see all predictors. For number of trees, low numbers are not great, as you can easily underfit the data and not produce meaningful results. Large numbers are fine and Random Forests do not overfit (in theory).

The full dataset has around 2000 observations, and 23 predictors (well even more, but let’s ignore it for the moment). I tuned mtry to be between 4 and 6, and trees to be between 1000 and 5000 in a 30 step increment. In total, with a 10-folds cross validation, I grew 30 random forests on each fold for a total of 300 Random Forests on the training set!!! This of course will take a loooooong time to compute on your computer if using one thread. So use parallel computing or a cluster. When running in the cluster with 20 cores, each with 11GB RAMs, and it took around 260.442 seconds to run with 220GB RAMS! Of course, with smaller RAMs and number of cores, the code will still run butwill take longer.

7.3.4 Workflow

Now we define the workflow adding the recipe and the model.

Warning in for (i in seq_along(a)) if (all(nam[i] != std.attr)) { :
  closing unused connection 6 (<-JalalXPS15:11554)
Warning in for (i in seq_along(a)) if (all(nam[i] != std.attr)) { :
  closing unused connection 5 (<-JalalXPS15:11554)

7.3.5 Tuning and running model

Here we run the model starting with the workflow, the cross-validation sample, the tuning parameters and asking for specific metrics. Below, we receive one warning:

  1. We did not define any tuning, and receive a warning about it.

Above, we added an option to suppress any warning messages from doFuture. If you do not use that option, you may receive a warning that some threads are not using correct random seeds. This is a false-positive well known to the developers. For more details, see this link, but also their github page; so you can ignore the warning.

No tuning parameters have been detected, performance will be evaluated using the resamples with no tuning. Did you want to [tune()] parameters?
   user  system elapsed 
   0.33    0.05    9.37 
# Tuning results
# 10-fold cross-validation using stratification 

7.3.6 Finalise model

We obtain the best performing model from cross-validation, then finalise the workflow by predicting the results on the testing set and obtain the results of the best performing model

7.4 Results

For the results, we can obtain various metrics on the training and testing sets.

7.4.2 Predictions testing set

7.4.2.1 Overall

[[1]]
NA

7.4.5 Gains curves

This is an interesting features that show how much is gained when looking at various portions of the data. We see a gradual increase in the values. When 50% of the data were tested, around 83% of the results within the non-guttural class were already identified. The more testing was performed, the more confidence in the results there are and then when 84.96% of the data were tested, 100% of the cases were found.

8 session info

R version 4.0.3 (2020-10-10)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 19041)

Matrix products: default

Random number generation:
 RNG:     L'Ecuyer-CMRG 
 Normal:  Inversion 
 Sample:  Rejection 
 
locale:
[1] LC_COLLATE=English_United Kingdom.1252 
[2] LC_CTYPE=English_United Kingdom.1252   
[3] LC_MONETARY=English_United Kingdom.1252
[4] LC_NUMERIC=C                           
[5] LC_TIME=English_United Kingdom.1252    

attached base packages:
[1] stats4    grid      stats     graphics  grDevices utils    
[7] datasets  methods   base     

other attached packages:
 [1] parallelly_1.23.0     doRNG_1.8.2           rngtools_1.5         
 [4] doFuture_0.12.0       future_1.21.0         foreach_1.5.1        
 [7] vip_0.3.2             lattice_0.20-41       varImp_0.4           
[10] measures_0.3          pROC_1.17.0.1         yardstick_0.0.7      
[13] workflows_0.2.1       tune_0.1.3            rsample_0.0.9        
[16] recipes_0.1.15        parsnip_0.1.5         modeldata_0.1.0      
[19] infer_0.5.4           dials_0.0.9           scales_1.1.1         
[22] tidymodels_0.1.2      ranger_0.12.1         party_1.3-7          
[25] strucchange_1.5-2     sandwich_3.0-0        zoo_1.8-8            
[28] modeltools_0.2-23     mvtnorm_1.1-1         PresenceAbsence_1.1.9
[31] psycho_0.6.1          corrplot_0.84         knitr_1.31           
[34] broom_0.7.5           forcats_0.5.1         stringr_1.4.0        
[37] dplyr_1.0.5           purrr_0.3.4           readr_1.4.0          
[40] tidyr_1.1.3           tibble_3.1.0          ggplot2_3.3.3        
[43] tidyverse_1.3.0      

loaded via a namespace (and not attached):
 [1] TH.data_1.0-10     colorspace_2.0-0   ellipsis_0.3.1    
 [4] class_7.3-18       rio_0.5.26         fs_1.5.0          
 [7] rstudioapi_0.13    farver_2.1.0       listenv_0.8.0     
[10] furrr_0.2.2        prodlim_2019.11.13 fansi_0.4.2       
[13] lubridate_1.7.10   coin_1.4-1         xml2_1.3.2        
[16] codetools_0.2-18   splines_4.0.3      libcoin_1.0-8     
[19] jsonlite_1.7.2     dbplyr_2.1.0       compiler_4.0.3    
[22] httr_1.4.2         backports_1.2.1    assertthat_0.2.1  
[25] Matrix_1.3-2       cli_2.3.1          htmltools_0.5.1.1 
[28] tools_4.0.3        gtable_0.3.0       glue_1.4.2        
[31] Rcpp_1.0.6         carData_3.0-4      jquerylib_0.1.3   
[34] cellranger_1.1.0   DiceDesign_1.9     vctrs_0.3.6       
[37] nlme_3.1-152       iterators_1.0.13   timeDate_3043.102 
[40] xfun_0.21          gower_0.2.2        globals_0.14.0    
[43] openxlsx_4.2.3     rvest_0.3.6        lifecycle_1.0.0   
[46] MASS_7.3-53.1      ipred_0.9-10       hms_1.0.0         
[49] parallel_4.0.3     yaml_2.2.1         curl_4.3          
[52] gridExtra_2.3      sass_0.3.1         rpart_4.1-15      
[55] stringi_1.5.3      lhs_1.1.1          hardhat_0.1.5     
[58] zip_2.1.1          lava_1.6.8.1       rlang_0.4.10      
[61] pkgconfig_2.0.3    matrixStats_0.58.0 evaluate_0.14     
[64] labeling_0.4.2     tidyselect_1.1.0   plyr_1.8.6        
[67] magrittr_2.0.1     R6_2.5.0           generics_0.1.0    
[70] multcomp_1.4-16    DBI_1.1.1          mgcv_1.8-34       
[73] pillar_1.5.1       haven_2.3.1        foreign_0.8-81    
[76] withr_2.4.1        survival_3.2-7     abind_1.4-5       
[79] nnet_7.3-15        modelr_0.1.8       crayon_1.4.1      
[82] car_3.0-10         utf8_1.1.4         rmarkdown_2.7     
[85] readxl_1.3.1       data.table_1.14.0  reprex_1.0.0      
[88] digest_0.6.27      GPfit_1.0-8        munsell_0.5.0     
[91] bslib_0.2.4       
LS0tDQp0aXRsZTogIkludHJvZHVjdGlvbiB0byBSYW5kb20gRm9yZXN0cyINCmF1dGhvcjogDQogIG5hbWU6ICJKYWxhbCBBbC1UYW1pbWkiDQogIGFmZmlsaWF0aW9uOiAiTmV3Y2FzdGxlIFVuaXZlcnNpdHkiDQpkYXRlOiAiYHIgZm9ybWF0KFN5cy50aW1lKCksICclZCAlQiAlWScpYCINCm91dHB1dDogDQogIGh0bWxfbm90ZWJvb2s6DQogICAgaGlnaGxpZ2h0OiBweWdtZW50cw0KICAgIG51bWJlcl9zZWN0aW9uczogeWVzDQogICAgdG9jOiB0cnVlDQogICAgdG9jX2RlcHRoOiA2DQogICAgdG9jX2Zsb2F0Og0KICAgICAgY29sbGFwc2VkOiB0cnVlDQogICAgICBzbW9vdGhfc2Nyb2xsOiB0cnVlDQogIA0KLS0tDQoNClRoaXMgbm90ZWJvb2sgcHJvdmlkZXMgZGV0YWlscyBvZiBob3cgdG8gZ3JvdyBSYW5kb20gRm9yZXN0cyBmb3IgcGhvbmV0aWMgZGF0YS4gVGhpcyBpcyBub3QgZXhjbHVzaXZlIHRvIHBob25ldGljIGRhdGEgYW5kIGNhbiBiZSB1c2VkIGZvciBhbnkgb3RoZXIgdHlwZSBvZiBkYXRhLiANCg0KV2Ugd2lsbCBzdGFydCBieSBsb29raW5nIGF0IHRoZSBiYXNpY3Mgb2YgcHJlZGljdGl2ZSBtb2RlbGxpbmcsIGJ5IGxvb2tpbmcgYXQgbG9naXN0aWMgcmVncmVzc2lvbiBhcyBhIGNsYXNzaWZpY2F0aW9uIHRvb2wgYW5kIHVzZSBzb21lIG5vdGlvbnMgZnJvbSB0aGUgU2lnbmFsIERldGVjdGlvbiBUaGVvcnkgKGFjY3VyYWN5LCBzZW5zaXRpdml0eSwgc3BlY2lmaWNpdHksIHJlY2FsbCwgZHByaW1lLCBBVUMpLiBXZSB0aGVuIGxvb2sgYXQgc29tZSBpc3N1ZXMgd2l0aCBsb2dpc3RpYyByZWdyZXNzaW9uIHJlbGF0ZWQgdG8gbXVsdGljb2xsaW5lYXJpdHkuIFdlIGludHJvZHVjZSB0aGVuIGRlY2lzaW9uIHRyZWVzIHRvIHVuZGVyc3RhbmQgaG93IHRoZXkgd29yaywgYmVmb3JlIGF0dGVtcHRpbmcgdG8gcmVwbGljYXRlIGhvdyBSYW5kb20gRm9yZXN0cyB3b3JrLiBXZSB0aGVuIGdyb3cgb3VyIGZpcnN0IFJhbmRvbSBGb3Jlc3RzIGFuZCB0cnkgdG8gY2FwdHVyZSBhcyBtdWNoIGluZm9ybWF0aW9uIGFzIHBvc3NpYmxlIGZyb20gaXQuIEF0IHRoZSBlbmQsIHdlIGxvb2sgYXQgdGhlIGFwcHJvYWNoIGFkdm9jYXRlZCBieSAgYHRpZHltb2RlbHNgLg0KQXQgdGhlIGVuZCBvZiB0aGUgc2Vzc2lvbiwgcGFydGljaXBhbnRzIHdpbGwgYmUgYWJsZSB0byBncm93IGEgUmFuZG9tIEZvcmVzdCBiYXNlZCBvbiB0aGVpciBvd24gZGF0YS4gDQoNCg0KDQojIExvYWRpbmcgcGFja2FnZXMgDQoNCg0KYGBge3Igd2FybmluZz1GQUxTRSwgbWVzc2FnZT1GQUxTRSwgZXJyb3I9RkFMU0V9DQojIyBVc2UgdGhlIGNvZGUgYmVsb3cgdG8gY2hlY2sgaWYgeW91IGhhdmUgYWxsIHJlcXVpcmVkIHBhY2thZ2VzIGluc3RhbGxlZC4gSWYgc29tZSBhcmUgbm90IGluc3RhbGxlZCBhbHJlYWR5LCB0aGUgY29kZSBiZWxvdyB3aWxsIGluc3RhbGwgdGhlc2UuIElmIHlvdSBoYXZlIGFsbCBwYWNrYWdlcyBpbnN0YWxsZWQsIHRoZW4gdGhlIHNlY29uZCBsaW5lIG9mIGNvZGUgd2lsbCBsYWQgdGhlbS4NCg0KcmVxdWlyZWRQYWNrYWdlcyA9IGMoJ3RpZHl2ZXJzZScsICdicm9vbScsICdrbml0cicsICdjb3JycGxvdCcsICdwc3ljaG8nLCAnUHJlc2VuY2VBYnNlbmNlJywgJ3BhcnR5JywgJ3JhbmdlcicsICd0aWR5bW9kZWxzJywgJ3BST0MnLCAndmFySW1wJywgJ2xhdHRpY2UnLCAndmlwJywgJ2RvRnV0dXJlJywgJ2RvUk5HJywgJ3BhcmFsbGVsbHknKQ0KZm9yKHAgaW4gcmVxdWlyZWRQYWNrYWdlcyl7DQogIGlmKCFyZXF1aXJlKHAsY2hhcmFjdGVyLm9ubHkgPSBUUlVFKSkgaW5zdGFsbC5wYWNrYWdlcyhwKQ0KICBsaWJyYXJ5KHAsY2hhcmFjdGVyLm9ubHkgPSBUUlVFKQ0KfQ0KDQoNCmBgYA0KDQojIERlY2xhcmUgcGFyYWxsZWwgY29tcHV0aW5nDQoNCmBSYCBpcyBhIHBvd2VyZnVsIHNvZnR3YXJlLiBJdCBpcyBkZXNpZ25lZCBieSBkZWZhdWx0IHRvIG9ubHkgdXNlIG9uZSBjb3JlIG9uIHlvdXIgbWFjaGluZS4gQXMgeW91IGtub3csIGFueSBsYXB0b3AvY29tcHV0ZXIgY29tZXMgd2l0aCBhdCBsZWFzdCB0d28gY29yZXMgKGlmIG5vdCBtb3JlKS4gTWluZSBoYXMgNCBwaHlzaWNhbCBjb3JlcyB3aXRoIG11bHRpaHRyZWFkaW5nIChpLmUuLCBhIHRvdGFsIG9mIDggbG9naWNhbCBjb3JlcykuIElmIEkgYW0gdG8gcnVuIGEgY29kZSB0aGF0IHJlcXVpcmVzIGhlYXZ5IGNvbXB1dGF0aW9ucywgSSB3aWxsIG5ldmVyIGV2ZXIgdXNlIG9uZSBjb3JlIChhcyBpdCB3aWxsIHRha2UgYWdlcyB0byBydW4pLiBUaGlzIGlzIHdoZXJlIHRoZSBhZGRpdGlvbmFsIHBvd2VyIG9mIFIgaXMgbmVlZGVkLiANCg0KV2UgY2FuIHVzZSBhbnkgcGFyYWxsZWwgY29tcHV0aW5nIHBhY2thZ2UuIEkgdXNlIHRoZSBgZG9GdXR1cmVgIHBhY2thZ2UgYXMgaXQgaXMgb25lIG9mIHRoZSBiZXN0IGJhY2tlbmQgcGFyYWxsZWwgY29tcHV0aW5nIHBhY2thZ2VzLiBJIGFtIGRlY2xhcmluZyBwYXJhbGxlbCBjb21wdXRpbmcgYmVsb3cgdXNpbmcgb25lIGNvcmUgb25seSwgYnV0IG9uIHlvdXIgbWFjaGluZSwgeW91IGNhbiB1c2UgYWxsIGNvcmVzDQoNCmBgYHtyfQ0KIyMgVG8gZGVmaW5lIHBhcmFsbGVsIGNvbXB1dGluZyBvbiB5b3VyIG1hY2hpbmUsIHVzZSB0aGUgcGFja2FnZSBkb0Z1dHVyZS4gVGhlIGNvZGUgYmVsb3cgc2hvd3MgaG93IHlvdSBjb3VsZCBkZWZpbmUgaXQgb24geW91ciBtYWNoaW5lLg0KIyAjRGVjbGFyZSBwYXJhbGxlbCBjb21wdXRpbmcgDQojIyBuY29yZXMgPC0gYXZhaWxhYmxlQ29yZXMoKQ0KbmNvcmVzIDwtIDINCmNhdChwYXN0ZTAoIk51bWJlciBvZiBjb3JlcyBhdmFpbGFibGUgZm9yIG1vZGVsIGNhbGN1bGF0aW9ucyBzZXQgdG8gIiwgbmNvcmVzLCAiLiIpKQ0KcmVnaXN0ZXJEb0Z1dHVyZSgpDQpjbCA8LSBwYXJhbGxlbGx5OjptYWtlQ2x1c3RlclBTT0NLKG5jb3JlcykNCnBsYW4oY2x1c3Rlciwgd29ya2VycyA9IGNsKQ0KbmNvcmVzDQpjbA0KDQojIGJlbG93IHdlIHJlZ2lzdGVyIG91ciByYW5kb20gbnVtYmVyIGdlbmVyYXRvci4gVGhpcyB3aWxsIG1vc3RseSBiZSB1c2VkIHdpdGhpbiB0aGUgdGlkeW1vZGVscyBiZWxvdy4gVGhpcyBhbGxvd3MgcmVwbGljYXRpb24gb2YgdGhlIHJlc3VsdHMNCnNldC5zZWVkKDEyMzQ1NikNCiMgYmVsb3cgdG8gc3VwcHJlc3MgYW55d2FybmluZ3MgZnJvbSBkb0Z1dHVyZQ0Kb3B0aW9ucyhkb0Z1dHVyZS5ybmcub25NaXN1c2UgPSAiaWdub3JlIikNCmBgYA0KDQoNCiMgSW50cm9kdWN0aW9uDQoNClRoZSBtYWpvcml0eSBvZiByZXNlYXJjaCBpbiBwaG9uZXRpY3MgYW5kIGxpbmd1aXN0aWNzIGxvb2tzIGF0IHRyYWRpdGlvbmFsIHN0YXRpc3RpY2FsIHRlY2huaXF1ZXMgdG8gZXZhbHVhdGUgZ3JvdXAgZGlmZmVyZW5jZXMsIHVzaW5nIGVpdGhlciBmcmVxdWVudGlzdCBvciBCYXllc2lhbiBmcmFtZXdvcmtzLiBXaGF0IGlzIGltcG9ydGFudCBpbiB0aGVzZSBmcmFtZXdvcmtzIGlzIHRvIGFzc2VzcyB3aGV0aGVyIGEgcGFydGljdWxhciBvdXRjb21lIGNhbiBiZSBleHBsYWluZWQgYnkgdGhlIHBvdGVudGlhbCBkaWZmZXJlbmNlcyB0aGF0IGV4aXN0IGluIGEgcHJlZGljdG9yLiBGb3IgZXhhbXBsZSwgd2UgbWF5IHdhbnQgdG8gZXhhbWluZSBpZiB0aGUgZGlmZmVyZW5jZXMgb2JzZXJ2ZWQgaW4gRjIgZnJlcXVlbmN5IGF0IHRoZSB2b3dlbCBtaWRwb2ludCBjYW4gYmUgZXhwbGFpbmVkIGJ5IHBsYWNlIG9mIGFydGljdWxhdGlvbiwgb3IgYWdlIG9yIGdlbmRlci4gRm9yIHRoaXMgd2UgdXNlIGEgbGluZWFyIHJlZ3Jlc3Npb24gKHdpdGggb3Igd2l0aG91dCBtaXhlZCBlZmZlY3RzIG1vZGVsbGluZykgd2l0aCB0aGUgZm9sbG93aW5nIGZvcm11bGE6IGBsbShGMiB+IHBsYWNlICsgYWdlICsgZ2VuZGVyKWAuIA0KDQpUaGlzIGFwcHJvYWNoIGNhbiBwb3RlbnRpYWxseSBleHBsYWluIHRoZSBkaWZmZXJlbmNlcyBhc3NvY2lhdGVkIHdpdGggdGhlIHByZWRpY3RvcnMsIGkuZS4sIHdlIGV2YWx1YXRlIHRoZWlyIGluZmx1ZW5jZSBvbiB0aGUgb3V0Y29tZS4gQnV0IGxldCdzIGFzayB0aGUgZm9sbG93aW5nIHF1ZXN0aW9uOiBjYW4gdGhlIG9ic2VydmVkIGRpZmZlcmVuY2VzIG9uIEYyIGZyZXF1ZW5jeSBhdCB0aGUgdm93ZWwgbWlkcG9pbnQgYmUgcHJlZGljdGl2ZSBvZiBncm91cCBkaWZmZXJlbmNlcyBhc3NvY2lhdGVkIHdpdGggZ2VuZGVyPyBMZXQncyBwdXQgaXQgZGlmZmVyZW50bHk6IGNhbiB3ZSBwcmVkaWN0IGdlbmRlciBkaWZmZXJlbmNlcyBiYXNlZCBvbiBGMiBmcmVxdWVuY2llcz8gV2hhdCB3b3VsZCBoYXBwZW4gaW4gdGhlIGZ1dHVyZT8gVGhpcyBpcyB3aGVyZSBwcmVkaWN0aXZlIG1vZGVsbGluZyBjb21lcyB0byB0aGUgcmVzY3VlLg0KDQpQcmVkaWN0aXZlIG1vZGVsbGluZyBpcyBhIHN0YXRpc3RpY2FsIHRlY2huaXF1ZSB0aGF0IHVzZXMgZWl0aGVyIHRyYWRpdGlvbmFsIG9yIG1hY2hpbmUgbGVhcm5pbmcgYXBwcm9hY2hlcyB0byBldmFsdWF0ZSBncm91cCBkaWZmZXJlbmNlIGFuZCBob3cgdGhleSBpbmZvcm0gZ3JvdXAgc2VwYXJhdGlvbi4gVGhleSBjYW4gYmUgdXNlZCB0byBwcmVkaWN0IGNoYW5nZXMgZWl0aGVyIG9uIHRoZSBjdXJyZW50IGRhdGEgb3IgaW4gdGhlIGZ1dHVyZS4gSWYgeW91IGJ1aWxkIGEgcHJlZGljdGl2ZSBtb2RlbCBiYXNlZCBvbiBwcmUtZXhpc3RpbmcgZGF0YSwgeW91IGNhbiB1c2UgdGhlIG1vZGVsJ3MgcHJlZGljdGlvbnMgdG86DQoNCjEuIFZhbGlkYXRlIHRoZSByZXN1bHRzIG9uIHRoZSBjdXJyZW50IHNldA0KMi4gUHJlZGljdCByZXN1bHRzIG9uIG5ldyByYW5nZXMgKGUuZy4sIGlmIHlvdSBoYXZlIHJlc3VsdHMgb24gYWdlIGdyb3VwIDMwLTUwLCBpbiB0aGVvcnksIHlvdSBjb3VsZCBwcmVkaWN0IHRoZSBwYXR0ZXJucyBmb3IgYWdlIDIwIG9yIDcwKQ0KMy4gUHJlZGljdCByZXN1bHRzIG9uIG5ldyBkYXRhLCBlaXRoZXIgb24gdGhlIHRlc3Rpbmcgc2V0IG9yIGFueSBuZXcgZGF0YSB5b3Ugb2J0YWluIGluIHRoZSBmdXR1cmUuIA0KDQoNClRvIHVuZGVyc3RhbmQgdGhpcyBmdXJ0aGVyLCB3ZSB3aWxsIHN0YXJ0IHdpdGggYSBzaW1wbGUgR2VuZXJhbGlzZWQgTGluZWFyIE1vZGVsIHByZWRpY3RpbmcgYSBwZXJjZXB0aW9uIGV4cGVyaW1lbnQgb24gZ3JhbW1hdGljYWxpdHkganVkZ2VtZW50LCBiZWZvcmUgbW92aW5nIHRvIERlY2lzaW9uIFRyZWVzIGFuZCBSYW5kb20gRm9yZXN0cy4gDQoNCiMgR2VuZXJhbGlzZWQgTGluZWFyIE1vZGVsDQoNCkhlcmUgd2Ugd2lsbCBsb29rIGF0IGFuIGV4YW1wbGUgd2hlbiB0aGUgb3V0Y29tZSBpcyBiaW5hcnkuIFRoaXMgc2ltdWxhdGVkIGRhdGEgaXMgc3RydWN0dXJlZCBhcyBmb2xsb3dzLiBXZSBhc2tlZCBvbmUgcGFydGljaXBhbnQgdG8gbGlzdGVuIHRvIDE2NSBzZW50ZW5jZXMsIGFuZCB0byBqdWRnZSB3aGV0aGVyIHRoZXNlIGFyZSAiZ3JhbW1hdGljYWwiIG9yICJ1bmdyYW1tYXRpY2FsIi4gVGhlcmUgd2VyZSAxMDUgc2VudGVuY2VzIHRoYXQgd2VyZSAiZ3JhbW1hdGljYWwiIGFuZCA2MCAidW5ncmFtbWF0aWNhbCIuIFRoaXMgZmljdGl0aW91cyBleGFtcGxlIGNhbiBhcHBseSBpbiBhbnkgb3RoZXIgc2l0dWF0aW9uLiBMZXQncyB0aGluayBHZW9ncmFwaHk6IDE2NSBsYW5kczogMTA1ICJmbGF0IiBhbmQgNjAgIm5vbi1mbGF0IiwgZXRjLiBUaGlzIGFwcGxpZXMgdG8gYW55IGNhc2Ugd2hlcmUgeW91IG5lZWQgdG8gImNhdGVnb3Jpc2UiIHRoZSBvdXRjb21lIGludG8gdHdvIGdyb3Vwcy4gDQoNCiMjIExvYWQgYW5kIHN1bW1hcmllcw0KDQpMZXQncyBsb2FkIGluIHRoZSBkYXRhIGFuZCBkbyBzb21lIGJhc2ljIHN1bW1hcmllcw0KDQpgYGB7cn0NCmdyYW1tYXRpY2FsIDwtIHJlYWRfY3N2KCJncmFtbWF0aWNhbC5jc3YiKQ0KZ3JhbW1hdGljYWwNCnN0cihncmFtbWF0aWNhbCkNCmhlYWQoZ3JhbW1hdGljYWwpDQpgYGANCg0KIyMgTm9ybWFsIEdMTQ0KDQpMZXQncyBydW4gYSBmaXJzdCBHTE0gKEdlbmVyYWxpc2VkIExpbmVhciBNb2RlbCkuIEEgR0xNIHVzZXMgYSBzcGVjaWFsIGZhbWlseSAiYmlub21pYWwiIGFzIGl0IGFzc3VtZXMgdGhlIG91dGNvbWUgaGFzIGEgYmlub21pYWwgZGlzdHJpYnV0aW9uLiBJbiBnZW5lcmFsLCByZXN1bHRzIGZyb20gYSBMb2dpc3RpYyBSZWdyZXNzaW9uIGFyZSBjbG9zZSB0byB3aGF0IHdlIGdldCBmcm9tIFNEVCAoc2VlIGFib3ZlKS4NCg0KVG8gcnVuIHRoZSByZXN1bHRzLCB3ZSB3aWxsIGNoYW5nZSB0aGUgcmVmZXJlbmNlIGxldmVsIGZvciBib3RoIHJlc3BvbnNlIGFuZCBncmFtbWF0aWNhbGl0eS4gVGhlIGJhc2ljIGFzc3VtcHRpb24gYWJvdXQgR0xNIGlzIHRoYXQgd2Ugc3RhcnQgd2l0aCBvdXIgcmVmZXJlbmNlIGxldmVsIGJlaW5nIHRoZSAibm8iIHJlc3BvbnNlcyB0byB0aGUgInVuZ3JhbW1hdGljYWwiIGNhdGVnb3J5LiBBbnkgY2hhbmdlcyB0byB0aGlzIHJlZmVyZW5jZSB3aWxsIGJlIHNlZW4gaW4gdGhlIGNvZWZmaWNpZW50cyBhcyAieWVzIiByZXNwb25zZXMgdG8gdGhlICJncmFtbWF0aWNhbCIgY2F0ZWdvcnkuDQoNCiMjIyBNb2RlbCBlc3RpbWF0aW9uIGFuZCByZXN1bHRzDQoNClRoZSByZXN1bHRzIGJlbG93IHNob3cgdGhlIGxvZ29kZHMgZm9yIG91ciBtb2RlbC4gDQoNCmBgYHtyfQ0KZ3JhbW1hdGljYWwgPC0gZ3JhbW1hdGljYWwgJT4lIA0KICBtdXRhdGUocmVzcG9uc2UgPSBmYWN0b3IocmVzcG9uc2UsIGxldmVscyA9IGMoIm5vIiwgInllcyIpKSwNCiAgICAgICAgIGdyYW1tYXRpY2FsaXR5ID0gZmFjdG9yKGdyYW1tYXRpY2FsaXR5LCBsZXZlbHMgPSBjKCJ1bmdyYW1tYXRpY2FsIiwgImdyYW1tYXRpY2FsIikpKQ0KDQpncmFtbWF0aWNhbCAlPiUgDQogIGdyb3VwX2J5KGdyYW1tYXRpY2FsaXR5LCByZXNwb25zZSkgJT4lIA0KICB0YWJsZSgpDQoNCm1kbC5nbG0gPC0gZ3JhbW1hdGljYWwgJT4lIA0KICBnbG0ocmVzcG9uc2UgfiBncmFtbWF0aWNhbGl0eSwgZGF0YSA9IC4sIGZhbWlseSA9IGJpbm9taWFsKQ0Kc3VtbWFyeShtZGwuZ2xtKQ0KDQp0aWR5KG1kbC5nbG0pICU+JSANCiAgc2VsZWN0KHRlcm0sIGVzdGltYXRlKSAlPiUgDQogIG11dGF0ZShlc3RpbWF0ZSA9IHJvdW5kKGVzdGltYXRlLCAzKSkNCiMgdG8gb25seSBnZXQgdGhlIGNvZWZmaWNpZW50cw0KbXljb2VmIDwtIHRpZHkobWRsLmdsbSkgJT4lIHB1bGwoZXN0aW1hdGUpDQpgYGANCg0KDQpUaGUgcmVzdWx0cyBzaG93IHRoYXQgZm9yIG9uZSB1bml0IGluY3JlYXNlIGluIHRoZSByZXNwb25zZSAoaS5lLiwgZnJvbSBubyB0byB5ZXMpLCB0aGUgbG9nb2RkcyBvZiBiZWluZyAiZ3JhbW1hdGljYWwiIGlzIGluY3JlYXNlZCBieSBgciBteWNvZWZbMl1gICh0aGUgaW50ZXJjZXB0IHNob3dzIHRoYXQgd2hlbiB0aGUgcmVzcG9uc2UgaXMgIm5vIiwgdGhlIGxvZ29kZHMgYXJlIGByIG15Y29lZlsxXWApLiBUaGUgYWN0dWFsIGxvZ29kZHMgZm9yIHRoZSByZXNwb25zZSAieWVzIiB0byBncmFtbWF0aWNhbCBpcyBgciBteWNvZWZbMV0gKyBteWNvZWZbMl1gIA0KDQoNCiMjIyBMb2dPZGRzIHRvIHByb3BvcnRpb25zDQoNCklmIHlvdSB3YW50IHRvIHRhbGsgYWJvdXQgdGhlIHBlcmNlbnRhZ2UgImFjY3VyYWN5IiBvZiBvdXIgbW9kZWwsIHRoZW4gd2UgY2FuIHRyYW5zZm9ybSBvdXIgbG9nZ29kZHMgaW50byBwcm9wb3J0aW9ucy4gVGhpcyBzaG93cyB0aGF0IHRoZSBwcm9wb3J0aW9uIG9mICJncmFtbWF0aWNhbCIgcmVjZWl2aW5nIGEgInllcyIgcmVzcG9uc2UgaW5jcmVhc2VzIGJ5IDk1JSANCg0KYGBge3J9DQpwbG9naXMobXljb2VmWzFdKQ0KcGxvZ2lzKG15Y29lZlsxXSArIG15Y29lZlsyXSkNCmBgYA0KDQojIyMgUGxvdHRpbmcNCg0KYGBge3J9DQpncmFtbWF0aWNhbCA8LSBncmFtbWF0aWNhbCAlPiUgDQogIG11dGF0ZShwcm9iID0gcHJlZGljdChtZGwuZ2xtLCB0eXBlID0gInJlc3BvbnNlIikpDQpncmFtbWF0aWNhbCAlPiUgDQogIGdncGxvdChhZXMoeCA9IGFzLm51bWVyaWMoZ3JhbW1hdGljYWxpdHkpLCB5ID0gcHJvYikpICsNCiAgZ2VvbV9wb2ludCgpICsNCiAgZ2VvbV9zbW9vdGgobWV0aG9kID0gImdsbSIsIA0KICAgICAgICAgICAgICBtZXRob2QuYXJncyA9IGxpc3QoZmFtaWx5ID0gImJpbm9taWFsIiksIHNlID0gVCkgKyANCiAgdGhlbWVfYncoYmFzZV9zaXplID0gMjApICsNCiAgbGFicyh5ID0gIlByb2JhYmlsaXR5IiwgeCA9ICIiKSArDQogIGNvb3JkX2NhcnRlc2lhbih5bGltID0gYygwLCAxKSwgeGxpbSA9IGMoMi4wNSwgMC45NSksIGV4cGFuZCA9IEZBTFNFKSArDQogIHNjYWxlX3hfZGlzY3JldGUobGltaXRzID0gYygiVUdyYW1tIiwgIkdyYW1tIikpDQpgYGANCg0KIyMgQWNjdXJhY3kgYW5kIFNpZ25hbCBEZXRlY3Rpb24gVGhlb3J5DQoNCiMjIyBSYXRpb25hbGUNCg0KV2UgYXJlIGdlbmVyYWxseSBpbnRlcmVzdGVkIGluIHBlcmZvcm1hbmNlLCBpLmUuLCB3aGV0aGVyIHRoZSB3ZSBoYXZlICJhY2N1cmF0ZWx5IiBjYXRlZ29yaXNlZCB0aGUgb3V0Y29tZSBvciBub3QgYW5kIGF0IHRoZSBzYW1lIHRpbWUgd2FudCB0byBldmFsdWF0ZSBvdXIgYmlhc2VzIGluIHJlc3BvbnNlcy4gV2hlbiBkZWNpZGluZyBvbiBjYXRlZ29yaWVzLCB3ZSBhcmUgdXN1YWxseSBiaWFzZWQgaW4gb3VyIHNlbGVjdGlvbi4gDQoNCkxldCdzIGFzayB0aGUgcXVlc3Rpb246IEhvdyBtYW55IG9mIHlvdSBoYXZlIGEgTWFjIGxhcHRvcCBhbmQgaG93IG1hbnkgYSBXaW5kb3dzIGxhcHRvcD8gRm9yIHRob3NlIHdpdGggYSBNYWMsIHdoYXQgd2FzIHRoZSBtYWluIHJlYXNvbiBmb3IgY2hvb3NpbmcgaXQ/IEFyZSB5b3UgYmlhc2VkIGluIGFueXdheSBieSB5b3VyIGRlY2lzaW9uPyANCg0KSWYgd2UgZ28gYmFjayB0byBvdXIgZ3JhbW1hdGljYWwgZXhhbXBsZSBhYm92ZSwgd2Ugd2FudCB0byBldmFsdWF0ZSBpZiB0aGUgcGFydGljaXBhbnQgd2FzIGJpYXNlZCBpbiBhbnl3YXkgd2hpbGUgcmVzcG9uZGluZy4gVG8gY29ycmVjdCBmb3IgdGhlc2UgYmlhc2VzLCB3ZSB1c2Ugc29tZSB2YXJpYW50cyBmcm9tIFNpZ25hbCBEZXRlY3Rpb24gVGhlb3J5IHRvIG9idGFpbiB0aGUgdHJ1ZSBlc3RpbWF0ZXMgd2l0aG91dCBiZWluZyBpbmZsdWVuY2VkIGJ5IHRoZSBiaWFzZXMuIA0KDQojIyMgUnVubmluZyBzdGF0cw0KDQpMZXQncyBkbyBzb21lIHN0YXRzIG9uIHRoaXMgDQoNCnwgIHwgWWVzIHwgTm8gfCBUb3RhbCB8DQp8LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS0tLS0tLS0tLXwtLS0tLS0tLS0tLS0tLS0tLS18LS0tLS0tLS0tLS0tLS0tLS0tfA0KfCBHcmFtbWF0aWNhbCAoWWVzIEFjdHVhbCkgfCBUUCA9IDEwMCB8IEZOID0gNSB8IChZZXMgQWN0dWFsKSAxMDUgfA0KfCBVbmdyYW1tYXRpY2FsIChObyBBY3R1YWwpICB8IEZQID0gMTAgfCBUTiA9IDUwIHwgKE5vIEFjdHVhbCkgNjAgfA0KfCBUb3RhbCB8IChZZXMgUmVzcG9uc2UpIDExMCB8IChObyBSZXNwb25zZSkgNTUgfCAxNjUgfA0KDQoNClRQID0gVHJ1ZSBQb3NpdGl2ZSAoSGl0KTsgRlAgPSBGYWxzZSBQb3NpdGl2ZTsgRk4gPSBGYWxzZSBOZWdhdGl2ZTsgVE4gPSBUcnVlIE5lZ2F0aXZlDQoNCg0KYGBge3J9DQpncmFtbWF0aWNhbCA8LSBncmFtbWF0aWNhbCAlPiUgDQogIG11dGF0ZShyZXNwb25zZSA9IGZhY3RvcihyZXNwb25zZSwgbGV2ZWxzID0gYygieWVzIiwgIm5vIikpLA0KICAgICAgICAgZ3JhbW1hdGljYWxpdHkgPSBmYWN0b3IoZ3JhbW1hdGljYWxpdHksIGxldmVscyA9IGMoImdyYW1tYXRpY2FsIiwgInVuZ3JhbW1hdGljYWwiKSkpDQoNCiMjIFRQID0gVHJ1ZSBQb3NpdGl2ZSAoSGl0KTsgRlAgPSBGYWxzZSBQb3NpdGl2ZTsgRk4gPSBGYWxzZSBOZWdhdGl2ZTsgVE4gPSBUcnVlIE5lZ2F0aXZlDQoNCg0KVFAgPC0gbnJvdyhncmFtbWF0aWNhbCAlPiUgDQogICAgICAgICAgICAgZmlsdGVyKGdyYW1tYXRpY2FsaXR5ID09ICJncmFtbWF0aWNhbCIgJg0KICAgICAgICAgICAgICAgICAgICAgIHJlc3BvbnNlID09ICJ5ZXMiKSkNCkZOIDwtIG5yb3coZ3JhbW1hdGljYWwgJT4lIA0KICAgICAgICAgICAgIGZpbHRlcihncmFtbWF0aWNhbGl0eSA9PSAiZ3JhbW1hdGljYWwiICYNCiAgICAgICAgICAgICAgICAgICAgICByZXNwb25zZSA9PSAibm8iKSkNCkZQIDwtIG5yb3coZ3JhbW1hdGljYWwgJT4lIA0KICAgICAgICAgICAgIGZpbHRlcihncmFtbWF0aWNhbGl0eSA9PSAidW5ncmFtbWF0aWNhbCIgJg0KICAgICAgICAgICAgICAgICAgICAgIHJlc3BvbnNlID09ICJ5ZXMiKSkNClROIDwtIG5yb3coZ3JhbW1hdGljYWwgJT4lIA0KICAgICAgICAgICAgIGZpbHRlcihncmFtbWF0aWNhbGl0eSA9PSAidW5ncmFtbWF0aWNhbCIgJg0KICAgICAgICAgICAgICAgICAgICAgIHJlc3BvbnNlID09ICJubyIpKQ0KVFANCkZODQpGUA0KVE4NCg0KVG90YWwgPC0gbnJvdyhncmFtbWF0aWNhbCkNClRvdGFsDQpgYGANCg0KIyMjIyBBY2N1cmFjeSByYXRlDQoNCkFjY3VyYWN5IGlzIHNpbXBseSB0aGUgc3VtIG9mIHRydWUgcG9zaXRpdmVzIGFuZCB0cnVlIG5lZ2F0aXZlcyBkaXZpZGVkIGJ5IHRoZSB0b3RhbC4gDQoNCmBgYHtyfQ0KKFRQK1ROKS9Ub3RhbA0KYGBgDQoNCiMjIyMgRXJyb3IgcmF0ZQ0KDQpUaGUgZXJyb3IgcmF0ZSBjYW4gYmUgY29tcHV0ZWQgYXMgMS1hY2N1cmFjeSBvciBzdW0gb2YgZmFsc2UgcG9zaXRpdmVzIGFuZCBmYWxzZSBuZWdhdGl2ZXMgZGl2aWRlZCBieSB0aGUgdG90YWwuDQoNCg0KYGBge3J9DQooRlArRk4pL1RvdGFsICMgZXJyb3IsIGFsc28gMS1hY2N1cmFjeQ0KYGBgDQoNCiMjIyMgU3BlY2lmaWNpdHkgDQoNCkxldCB1cyBhc2sgdGhlIGZvbGxvd2luZyBxdWVzdGlvbjogV2hlbiB0aGUgKipzdGltdWx1cyA9IHllcyoqLCBob3cgbWFueSB0aW1lcyB0aGUgKipyZXNwb25zZSA9IHllcyoqPyANCg0KSGVyZSB3ZSBxdWFudGlmeSB0aGUgdHJ1ZSBwb3NpdGl2ZSByYXRlIG9yIHNwZWNpZmljaXR5LiANCg0KYGBge3J9DQpUUC8oVFArRk4pICMgYWxzbyBUcnVlIFBvc2l0aXZlIFJhdGUgb3IgU3BlY2lmaWNpdHkNCmBgYA0KDQojIyMjIEZhbHNlIHBvc2l0aXZlIHJhdGUNCg0KTGV0IHVzIGFzayB0aGUgZm9sbG93aW5nIHF1ZXN0aW9uOiBXaGVuIHRoZSAqKnN0aW11bHVzID0gbm8qKiwgaG93IG1hbnkgdGltZXMgdGhlICoqcmVzcG9uc2UgPSB5ZXMqKj8gDQoNCmBgYHtyfQ0KRlAvKEZQK1ROKSAjIEZhbHNlIFBvc2l0aXZlIFJhdGUNCmBgYA0KDQojIyMjIFNlbnNpdGl2aXR5IA0KDQpTZW5zaXRpdml0eSBxdWFudGlmeSB0aGUgcmVqZWN0aW9uIHJhdGUgYW5kIGV2YWx1YXRlcyB0aGUgc2Vuc2l0aXZpdHkgb2YgdGhlIG1vZGUuIA0KDQpMZXQgdXMgYXNrIHRoZSBmb2xsb3dpbmcgcXVlc3Rpb246IFdoZW4gdGhlICoqc3RpbXVsdXMgPSBubyoqLCBob3cgbWFueSB0aW1lcyB0aGUgKipyZXNwb25zZSA9IG5vKio/DQoNCmBgYHtyfQ0KVE4vKEZQK1ROKSAjIFRydWUgTmVnYXRpdmUgUmF0ZSBvciBTZW5zaXRpdml0eSANCmBgYA0KDQojIyMjIFByZWNpc2lvbg0KDQpMZXQgdXMgYXNrIHRoZSBmb2xsb3dpbmcgcXVlc3Rpb246IFdoZW4gdGhlIHN1YmplY3QgcmVzcG9uZHMgYHllc2AsIGhvdyBtYW55IHRpbWVzIGlzIChzKWhlIGNvcnJlY3Q/DQoNCmBgYHtyfQ0KVFAvKFRQK0ZQKSAjIHByZWNpc2lvbg0KYGBgDQoNCiMjIyMgRFByaW1lIGFuZCBvdGhlciBTRFQgbWV0cmljcw0KDQpXZSB1c2UgdGhlIGxpYnJhcnkgYHBzeWNob2AgdG8gb2J0YWluIFNEVCBtZXRyaWNzLiANCg0KT25lIG9mIHRoZSBtb3N0IGltcG9ydGFudCBtZXRyaWNzIGlzIGBkcHJpbWVgLiBUaGlzIGlzIHVzdWFsbHkgdXNlZCBpbiBwZXJjZXB0aW9uIGV4cGVyaW1lbnRzIGFzIGl0IGFsbG93cyB0byB0YWtlIGludG8gYWNjb3VudCBib3RoIHNlbnNpdGl2aXR5IGFuZCBzcGVjaWZpY2l0eS4gVGhpcyBtZWFucywgaXQgYWxsb3dzIHRvIGNvcnJlY3QgZm9yIGJpYXNlcyBpbiBlc3RpbWF0aW9uLiANCg0KVGhlIHZhcmlvdXMgbWV0cmljcyBjb21wdXRlZCBhcmU6DQoNCjEuIGBkcHJpbWVgIG9yIHRoZSBzZW5zaXRpdml0eSBpbmRleC4gQmV0d2VlbiAtNiB0byArNi4gcG9zaXRpdmUgPSBhY2N1cmF0ZSBkZXRlY3Rpb247ICs2ID0gbWF4aW11bSBkZXRlY3Rpb247IDAgbm8gZGV0ZWN0aW9uOyBuZWdhdGl2ZSA9IG1vcmUgbm9pc2UgKGkuZS4sICJubyIgcmVzcG9uc2VzKSBpbiB0aGUgZGF0YQ0KMi4gYGJldGFgIG9yIHRoZSBiaWFzIGNyaXRlcmlvbi4gQmV0d2VlbiAwLTE6IGxvd2VyID0gaW5jcmVhc2UgaW4gInllcyIgcmVzcG9uc2VzDQozLiBgQXByaW1lYCBvciBlc3RpbWF0ZSBvZiBkaXNjcmltaW5hYmlsaXR5LiBCZXR3ZWVuIDAtMTogMSA9IGdvb2QgZGlzY3JpbWluYXRpb247IDAgaXMgYXQgY2hhbmNlDQo0LiBgYnBwZGAgb3IgdGhlICJiIHByaW1lIHByaW1lIGQiLiBCZXR3ZWVuIC0xIGFuZCAxOiAwID0gbm8gYmlhcywgbmVnYXRpdmUgPSB0ZW5kZW5jeSB0byByZXNwb25kICJ5ZXMiLCBwb3NpdGl2ZSA9IHRlbmRlbmN5IHRvIHJlc3BvbmQgIm5vIikNCjUuIGBjYCBvciB0aGUgaW5kZXggb2YgYmlhcy4gZXF1YWxzIHRvIFNELg0KDQpGb3IgbW9yZSBkZXRhaWxzLCBzZWUgW2xpbmtdKGh0dHBzOi8vd3d3LnItYmxvZ2dlcnMuY29tL2NvbXB1dGUtc2lnbmFsLWRldGVjdGlvbi10aGVvcnktaW5kaWNlcy13aXRoLXIvYW1wLykgDQoNCkZyb20gb3VyIHBlcnNwZWN0aXZlIGhlcmUsIHRoZSBtb3N0IGltcG9ydGFudCBpcyBkLXByaW1lIChhbmQgdGhlIG90aGVyIHNlc3BldGl2aXR5L3NwZWNpZmljaXR5IG1ldHJpY3MpLiANClRoaXMgaXMgbW9kZWxsaW5nIHRoZSBkaWZmZXJlbmNlIGJldHdlZW4gdGhlIHJhdGUgb2YgIlRydWUgUG9zaXRpdmUiIHJlc3BvbnNlcyBhbmQgIkZhbHNlIFBvc2l0aXZlIiByZXNwb25zZXMgaW4gc3RhbmRhcmQgdW5pdCAob3Igei1zY29yZXMpLiBUaGUgZm9ybXVsYSBjYW4gYmUgd3JpdHRlbiBhczoNCg0KYGQnIChkIHByaW1lKSA9IFooVHJ1ZSBQb3NpdGl2ZSBSYXRlKSAtIFooRmFsc2UgUG9zaXRpdmUgUmF0ZSlgDQoNCmBgYHtyfQ0KcHN5Y2hvOjpkcHJpbWUoVFAsIEZQLCBGTiwgVE4sIA0KICAgICAgICAgICAgICAgbl90YXJnZXRzID0gVFArRk4sIA0KICAgICAgICAgICAgICAgbl9kaXN0cmFjdG9ycyA9IEZQK1ROLA0KICAgICAgICAgICAgICAgYWRqdXN0ID0gRkFMU0UpDQoNCmBgYA0KDQoNCiMjIyBHTE0gYW5kIGQgcHJpbWUNCg0KVGhlIHZhbHVlcyBvYnRhaW5lZCBoZXJlIG1hdGNoIHRob3NlIG9idGFpbmVkIGZyb20gU0RULiBGb3IgZCBwcmltZSwgdGhlIGRpZmZlcmVuY2Ugc3RlbXMgZnJvbSB0aGUgdXNlIG9mIHRoZSBsb2dpdCB2YXJpYW50IG9mIHRoZSBCaW5vbWlhbCBmYW1pbHkuIEJ5IHVzaW5nIGEgcHJvYml0IHZhcmlhbnQsIG9uZSBvYnRhaW5zIHRoZSBzYW1lIHZhbHVlcyAoW3NlZSBoZXJlXShodHRwczovL3N0YXRzLmlkcmUudWNsYS5lZHUvci9kYWUvcHJvYml0LXJlZ3Jlc3Npb24vKSBmb3IgbW9yZSBkZXRhaWxzKS4gQSBwcm9iaXQgdmFyaWFudCBtb2RlbHMgdGhlIHotc2NvcmUgZGlmZmVyZW5jZXMgaW4gdGhlIG91dGNvbWUgYW5kIGlzIGV2YWx1YXRlZCBpbiBjaGFuZ2UgaW4gMS1zdGFuZGFyZCB1bml0LiBUaGlzIGlzIG1vZGVsbGluZyB0aGUgY2hhbmdlIGZyb20gInVuZ3JhbW1hdGljYWwiICJubyIgcmVzcG9uc2VzIGludG8gImdyYW1tYXRpY2FsIiAieWVzIiByZXNwb25zZXMgaW4gei1zY29yZXMuIFRoZSBzYW1lIGNvbmNlcHR1YWwgdW5kZXJwaW5uaW5ncyBvZiBkLXByaW1lIGZyb20gU2lnbmFsIERldGVjdGlvbiBUaGVvcnkuDQoNCmBgYHtyfQ0KIyMgZCBwcmltZQ0KcHN5Y2hvOjpkcHJpbWUoVFAsIEZQLCBGTiwgVE4sIA0KICAgICAgICAgICAgICAgbl90YXJnZXRzID0gVFArRk4sIA0KICAgICAgICAgICAgICAgbl9kaXN0cmFjdG9ycyA9IEZQK1ROLA0KICAgICAgICAgICAgICAgYWRqdXN0ID0gRkFMU0UpJGRwcmltZQ0KDQojIyBHTE0gd2l0aCBwcm9iaXQNCmNvZWYoZ2xtKHJlc3BvbnNlIH4gZ3JhbW1hdGljYWxpdHksIGRhdGEgPSBncmFtbWF0aWNhbCwgZmFtaWx5ID0gYmlub21pYWwocHJvYml0KSkpWzJdDQoNCmBgYA0KDQoNClRoZSBsb2dpdCB2YXJpYW50IG9mIHRoZSBHTE0gcmVwb3J0cyB0aGUgY29lZmZpY2llbnRzIGZvciB0aGUgVHJ1ZSBQb3NpdGl2ZSBSYXRlIG9yIFNwZWNpZmljaXR5OyB0aGUgcHJvYml0IHZhcmlhbnQgcmVwb3J0cyBvbiBkcHJpbWUsIG9yIHRoZSBkaWZmZXJlbmNlIGJldHdlZW4gdGhlIFRydWUgUG9zaXRpdmUgcmVzcG9uc2VzIGFuZCB0aGUgRmFsc2UgUG9zaXRpdmUgcmVzcG9uc2VzIGluIHN0YW5kYXJkIHVuaXRzLg0KDQoNCiMjIyBHTE0gYXMgYSBjbGFzc2lmaWNhdGlvbiB0b29sDQoNClRoZSBjb2RlIGJlbG93IGRlbW9uc3RyYXRlcyB0aGUgbGlua3MgYmV0d2VlbiBvdXIgR0xNIG1vZGVsIGFuZCB3aGF0IHdlIGhhZCBvYnRhaW5lZCBhYm92ZSBmcm9tIFNEVC4gVGhlIHByZWRpY3Rpb25zJyB0YWJsZSBzaG93cyB0aGF0IG91ciBHTE0gd2FzIHN1Y2Nlc3NmdWwgYXQgb2J0YWluaW5nIHByZWRpY3Rpb24gdGhhdCBhcmUgaWRlbnRpY2FsIHRvIG91ciBpbml0aWFsIGRhdGEgc2V0dXAuIExvb2sgYXQgdGhlIHRhYmxlIGhlcmUgYW5kIHRoZSB0YWJsZSBhYm92ZS4gT25jZSB3ZSBoYXZlIGNyZWF0ZWQgb3VyIHRhYmxlIG9mIG91dGNvbWUsIHdlIGNhbiBjb21wdXRlIHBlcmNlbnQgY29ycmVjdCwgdGhlIHNwZWNpZmljaXR5LCB0aGUgc2Vuc2l0aXZpdHksIGV0Yy4gVGhpcyB5aWVsZHMgdGhlIGFjdHVhbCB2YWx1ZSB3aXRoIHRoZSBTRCB0aGF0IGlzIHJlbGF0ZWQgdG8gdmFyaWF0aW9ucyBpbiByZXNwb25zZXMuIA0KDQpgYGB7cn0NCm1kbC5nbG0uQyA8LSBncmFtbWF0aWNhbCAlPiUgDQogIGdsbShyZXNwb25zZSB+IGdyYW1tYXRpY2FsaXR5LCBkYXRhID0gLiwgZmFtaWx5ID0gYmlub21pYWwpDQpwcmVkLmdyYW1tIDwtIHByZWRpY3QobWRsLmdsbS5DLCB0eXBlID0gInJlc3BvbnNlIikNCg0KdGJsLmdsbSA8LSB0YWJsZShncmFtbWF0aWNhbCRyZXNwb25zZSwgcHJlZC5ncmFtbSkNCmNvbG5hbWVzKHRibC5nbG0pIDwtIGMoImdyYW1tYXRpY2FsIiwgInVuZ3JhbW1hdGljYWwiKQ0KdGJsLmdsbQ0KIyBmcm9tIFByZXNlbmNlQWJzZW5jZQ0KUHJlc2VuY2VBYnNlbmNlOjpwY2ModGJsLmdsbSkNClByZXNlbmNlQWJzZW5jZTo6c3BlY2lmaWNpdHkodGJsLmdsbSkNClByZXNlbmNlQWJzZW5jZTo6c2Vuc2l0aXZpdHkodGJsLmdsbSkNCg0Kcm9jLmdyYW1tIDwtIHBST0M6OnJvYyhncmFtbWF0aWNhbCRncmFtbWF0aWNhbGl0eSwgcHJlZC5ncmFtbSkNCnJvYy5ncmFtbQ0KcFJPQzo6cGxvdC5yb2Mocm9jLmdyYW1tLCBsZWdhY3kuYXhlcyA9IFRSVUUpDQpgYGANCg0KSWYgeW91IGxvb2sgYXQgdGhlIHJlc3VsdHMgZnJvbSBTRFQgYWJvdmUsIHRoZXNlIHJlc3VsdHMgYXJlIHRoZSBzYW1lIGFzDQp0aGUgZm9sbG93aW5nDQoNCkFjY3VyYWN5OiAoVFArVE4pL1RvdGFsIChgciAoVFArVE4pL1RvdGFsYCkgDQoNClRydWUgUG9zaXRpdmUgUmF0ZSAob3IgU3BlY2lmaWNpdHkpIFRQLyhUUCtGTikgKGByIFRQLyhUUCtGTilgKQ0KDQpUcnVlIE5lZ2F0aXZlIFJhdGUgKG9yIFNlbnNpdGl2aXR5KSBUTi8oRlArVE4pIChgciBUTi8oRlArVE4pYCkgDQoNClRoZSBBcmVhIFVuZGVyIHRoZSBDdXJ2ZSAoQVVDKSBpcyB1c3VhbGx5IHVzZWQgdG8gYXNzZXNzIHRoZSBtb2RlbCdzIHBlcmZvcm1hbmNlLiBBcyB5b3Ugc2VlLCB3ZSB1c2UgdGhlIHNlbnNpdGl2aXR5IG9uIHRoZSB5LWF4aXMgYW5kIHRoZSBpbnZlcnNlIG9mIHNwZWNpZmljaXR5ICgxLXNwZWNpZmljaXR5KSBvbiB0aGUgeC1heGlzLiBUaGUgQVVDIGZvciB0aGlzIGRhdGEgaXMgMSwgaS5lLiwgcGVyZmVjdCBwcmVkaWN0aW9ucyBhbmQgaWYgeW91IGxvb2sgYXQgdGhlIEFVQyBwbG90LCBpdCBzaG93cyBhIHBlcmZlY3QgYWNjdXJhY3kgYW5kIGRldGVjdGlvbi4gVGhpcyBpcyB1c3VhbGx5IHJhcmUgYnV0IGNhbiBiZSBvYnRhaW5lZC4gUmVjYWxsIHRoYXQgdGhpcyBpcyBhIG1hZGUtdXAgZGF0YXNldCBmb3IgZGVtb25zdHJhdGlvbiBvbmx5ISANCg0KTm93IGxldHMgY29udGludWUgd2l0aCBhIHJlYWwgZGF0YXNldC4gDQoNCiMjIElzc3VlcyB3aXRoIEdMTQ0KDQpMZXQncyBsb29rIGF0IGEgbmV3IGRhdGFzZXQgdGhhdCBjb21lcyBmcm9tIHBob25ldGljIHJlc2VhcmNoLiBUaGlzIGRhdGFzZXQgaXMgZnJvbSBteSBjdXJyZW50IHdvcmsgb24gdGhlIGBwaG9uZXRpYyBiYXNpcyBvZiB0aGUgZ3V0dHVyYWwgbmF0dXJhbCBjbGFzcyBpbiBMZXZhbnRpbmUgQXJhYmljYC4gQWNvdXN0aWMgYW5hbHlzZXMgd2VyZSBjb25kdWN0ZWQgb24gbXVsdGlwbGUgcG9ydGlvbnMgb2YgdGhlIFZDViBzZXF1ZW5jZSwgYW5kIHdlIHJlcG9ydCBoZXJlIHRoZSBhdmVyYWdlZCByZXN1bHRzIG9uIHRoZSBmaXJzdCBoYWxmIG9mIFYyLiBBY291c3RpYyBtZXRyaWNzIHdlcmUgb2J0YWluZWQgdmlhIFZvaWNlU2F1Y2U6IHZhcmlvdXMgYWNvdXN0aWMgbWV0cmljcyBvZiBzdXByYWxhcnluZ2VhbCAoYmFyayBkaWZmZXJlbmNlKSBhbmQgbGFyeW5nZWFsICh2b2ljZSBxdWFsaXR5IHZpYSBhbXBsaXR1ZGUgaGFybW9uaWMgZGlmZmVyZW5jZXMsIG5vaXNlLCBlbmVyZ3kpIHdlcmUgb2J0YWluZWQuIEEgdG90YWwgb2YgMjMgZGlmZmVyZW50IGFjb3VzdGljIG1ldHJpY3Mgd2VyZSBvYnRhaW5lZCBmcm9tIDEwIHBhcnRpY2lwYW50cy4gSGVyZSwgd2UgdXNlIHRoZSBkYXRhIGZyb20gdGhlIGZpcnN0IHR3byBwYXJ0aWNpcGFudHMgZm9yIGRlbW9uc3RyYXRpb24gcHVycG9zZXMgKG9uZSBtYWxlIGFuZCBvbmUgZmVtYWxlKS4gVGhlIGdyb3VwaW5nIGZhY3RvciBvZiBpbnRlcmVzdCBpcyBjb250ZXh0IHdpdGggdHdvIGxldmVsczogYGd1dHR1cmFsYCB2cyBgbm9uLWd1dHR1cmFsYC4gR3V0dHVyYWxzIGluY2x1ZGUgIHV2dWxhciwgcGhhcnluZ2VhbGlzZWQgYW5kIHBoYXJ5bmdlYWwgY29uc29uYW50czsgbm9uLWd1dHR1cmFscyBpbmNsdWRlIGNvcm9uYWwgcGxhaW4sIHZlbGFyIGFuZCBnbG90dGFsIGNvbnNvbmFudHMuICANCg0KVGhlIGFpbSBvZiB0aGUgc3R1ZHkgd2FzIHRvIGV2YWx1YXRlIHdoZXRoZXIgdGhlIGNvbWJpbmF0aW9uIG9mIHRoZSBhY291c3RpYyBtZXRyaWNzIHByb3ZpZGVzIHN1cHBvcnQgZm9yIGEgZGlmZmVyZW5jZSBiZXR3ZWVuIHRoZSB0d28gY2xhc3NlcyBvZiBndXR0dXJhbHMgdnMgbm9uLWd1dHR1cmFscy4gDQoNCiMjIyBMb2FkIGFuZCBzdW1tYXJpc2UNCg0KYGBge3J9DQpkZlBoYXJWMiA8LSByZWFkX2NzdigiZGZQaGFyVjIuY3N2IikNCmRmUGhhclYyDQpgYGANCg0KDQojIyMgRmlyc3QgcHJlZGljdGl2ZSBtb2RlbA0KDQojIyMjIExpbmVhciBtb2RlbA0KDQpMZXQncyBzdGFydCBieSBhIHNpbXBsZSBsaW5lYXIgbW9kZWwgdG8gZXZhbHVhdGUgcmVsYXRpb25zaGlwIGJldHdlZW4gYSBwYXJ0aWN1bGFyIG1lYXN1cmUgYFoyLVoxYCBhbmQgdGhlIGNvbnRleHQuDQoNCmBgYHtyfQ0KZGZQaGFyVjIgPC0gZGZQaGFyVjIgJT4lIA0KICBtdXRhdGUoY29udGV4dCA9IGZhY3Rvcihjb250ZXh0LCBsZXZlbHMgPSBjKCJOb24tR3V0dHVyYWwiLCAiR3V0dHVyYWwiKSkpDQoNCmRmUGhhclYyICU+JSANCiAgbG0oWjJtbloxIH4gY29udGV4dCwgZGF0YSA9IC4pICU+JSANCiAgc3VtbWFyeSgpDQpgYGANCg0KDQpXaGF0IHRoaXMgcmVzdWx0IGlzIHRlbGxpbmcgdXMgaXMgdGhhdCB0aGVyZSBpcyBhIHN0YXRpc3RpY2FsbHkgc2lnbmlmaWNhbnQgZGVjcmVhc2UgaW4gYFoyLVoxYCBpbiB0aGUgZ3V0dHVyYWwgY2xhc3Mgd2hlbiBjb21wYXJlZCB3aXRoIHRoZSBub24tZ3V0dHVyYWwgKGlnbm9yaW5nIHRoZSBmYWN0IHRoYXQgd2UgbmVlZCBtaXhlZCBtb2RlbGxpbmcgdG8gZXZhbHVhdGUgdGhlIHJlc3VsdHMpLiBOb3cgbGV0J3MgYXNrIHRoZSBxdWVzdGlvbjogd2l0aCB0aGlzIGxpbmVhciBtb2RlbCwgY2FuIHlvdSBwcmVkaWN0IHBlcmNlbnRhZ2Ugc2VwYXJhdGlvbiBiZXR3ZWVuIHRoZSB0d28gY2xhc3Nlcz8gQXJlIHlvdSBhYmxlIHRvIHRlbGwgaWYgdGhlIGRpZmZlcmVuY2VzIG9ic2VydmVkIGJldHdlZW4gdGhlIHR3byBjbGFzc2VzIGFyZSBtZWFuaW5nZnVsPyBUaGlzIGlzIHdoZXJlIHdlIG5lZWQgdG8gY2hhbmdlIG91ciB3YXkgb2YgbG9va2luZyBhdCB0aGUgZGF0YS4gTGV0J3MgbG9vayBhdCBHTE0gYXMgYSBjbGFzc2lmaWNhdGlvbiB0b29sIGFzIGFib3ZlIA0KDQoNCiMjIyMgR0xNIGFzIGEgY2xhc3NpZmljYXRpb24gdG9vbA0KDQojIyMjIyBNb2RlbCBzcGVjaWZpY2F0aW9uDQoNCldlIHJ1biBhIEdMTSB3aXRoIGBjb250ZXh0YCBhcyBvdXIgb3V0Y29tZSwgYW5kIGBaMi1aMWAgYXMgb3VyIHByZWRpY3Rvci4gV2Ugd2FudCB0byBldmFsdWF0ZSB3aGV0aGVyIHRoZSB0d28gY2xhc3NlcyBjYW4gYmUgc2VwYXJhdGVkIHdoZW4gdXNpbmcgdGhlIGFjb3VzdGljIG1ldHJpYyBgWjItWjFgLiBDb250ZXh0IGhhcyB0d28gbGV2ZWxzLCBhbmQgdGhpcyB3aWxsIGJlIGNvbnNpZGVyZWQgYXMgYSBiaW5vbWlhbCBkaXN0cmlidXRpb24uIA0KDQoNCmBgYHtyfQ0KbWRsLmdsbS5aMm1uWjEgPC0gZGZQaGFyVjIgJT4lIA0KICBnbG0oY29udGV4dCB+IFoybW5aMSwgZGF0YSA9IC4sIGZhbWlseSA9IGJpbm9taWFsKQ0Kc3VtbWFyeShtZGwuZ2xtLloybW5aMSkNCnRpZHkobWRsLmdsbS5aMm1uWjEpICU+JSANCiAgc2VsZWN0KHRlcm0sIGVzdGltYXRlKSAlPiUgDQogIG11dGF0ZShlc3RpbWF0ZSA9IHJvdW5kKGVzdGltYXRlLCAzKSkNCiMgdG8gb25seSBnZXQgdGhlIGNvZWZmaWNpZW50cw0KbXljb2VmMiA8LSB0aWR5KG1kbC5nbG0uWjJtbloxKSAlPiUgcHVsbChlc3RpbWF0ZSkNCmBgYA0KDQojIyMjIyBQbG9naXMNCg0KVGhlIHJlc3VsdCBhYm92ZSBzaG93cyB0aGF0IHdoZW4gbW92aW5nIGZyb20gdGhlIGBub24tZ3V0dHVyYWxgIChpbnRlcmNlcHQpLCBhIHVuaXQgaW5jcmVhc2UgKGkuZS4sIGBndXR0dXJhbGApIHlpZWxkcyBhIHN0YXRpc3RpY2FsbHkgc2lnbmlmaWNhbnQgZGVjcmVhc2UgaW4gdGhlIGxvZ29kZHMgYXNzb2NpYXRlZCB3aXRoIGBaMi1aMWAuIFdlIGNhbiBldmFsdWF0ZSB0aGlzIGZ1cnRoZXIgZnJvbSBhIGNsYXNzaWZpY2F0aW9uIHBvaW50IG9mIHZpZXcsIHVzaW5nIGBwbG9naXNgLg0KDQoNCmBgYHtyfQ0KIyBub24tZ3V0dHVyYWwNCnBsb2dpcyhteWNvZWYyWzFdKQ0KI2d1dHR1cmFsDQpwbG9naXMobXljb2VmMlsxXSArIG15Y29lZjJbMl0pDQpgYGANCg0KDQpUaGlzIHNob3dzIHRoYXQgYFoyLVoxYCBpcyBhYmxlIHRvIGV4cGxhaW4gdGhlIGRpZmZlcmVuY2UgaW4gdGhlIGBndXR0dXJhbGAgY2xhc3Mgd2l0aCBhbiBhY2N1cmFjeSBvZiA1OSUuIExldCdzIGNvbnRpbnVlIHdpdGggdGhpcyBtb2RlbCBmdXJ0aGVyLg0KDQojIyMjIyBNb2RlbCBwcmVkaWN0aW9ucw0KDQpBcyBhYm92ZSwgd2Ugb2J0YWluIHByZWRpY3Rpb25zIGZyb20gdGhlIG1vZGVsLiBCZWNhdXNlIHdlIGFyZSB1c2luZyBhIG51bWVyaWMgcHJlZGljdG9yLCB3ZSBuZWVkIHRvIGFzc2lnbiBhIHRocmVzaG9sZCBmb3IgdGhlIHByZWRpY3QgZnVuY3Rpb24uIFRoZSB0aHJlc2hvbGQgY2FuIGJlIHRob3VnaHQgb2YgYXMgdGVsbGluZyB0aGUgcHJlZGljdCBmdW5jdGlvbiB0byBhc3NpZ24gYW55IHByZWRpY3Rpb25zIGxvd2VyIHRoYW4gNTAlIHRvIG9uZSBncm91cCwgYW5kIGFueSBoaWdoZXIgdG8gYW5vdGhlci4gDQoNCmBgYHtyfQ0KcHJlZC5nbG0uWjJtbloxIDwtIHByZWRpY3QobWRsLmdsbS5aMm1uWjEsIHR5cGUgPSAicmVzcG9uc2UiKT4wLjUNCg0KdGJsLmdsbS5aMm1uWjEgPC0gdGFibGUocHJlZC5nbG0uWjJtbloxLCBkZlBoYXJWMiRjb250ZXh0KQ0Kcm93bmFtZXModGJsLmdsbS5aMm1uWjEpIDwtIGMoIk5vbi1HdXR0dXJhbCIsICJHdXR0dXJhbCIpDQp0YmwuZ2xtLloybW5aMQ0KIyBmcm9tIFByZXNlbmNlQWJzZW5jZQ0KUHJlc2VuY2VBYnNlbmNlOjpwY2ModGJsLmdsbS5aMm1uWjEpDQpQcmVzZW5jZUFic2VuY2U6OnNwZWNpZmljaXR5KHRibC5nbG0uWjJtbloxKQ0KUHJlc2VuY2VBYnNlbmNlOjpzZW5zaXRpdml0eSh0YmwuZ2xtLloybW5aMSkNCg0Kcm9jLmdsbS5aMm1uWjEgPC0gcFJPQzo6cm9jKGRmUGhhclYyJGNvbnRleHQsIGFzLm51bWVyaWMocHJlZC5nbG0uWjJtbloxKSkNCnJvYy5nbG0uWjJtbloxDQpwUk9DOjpwbG90LnJvYyhyb2MuZ2xtLloybW5aMSwgbGVnYWN5LmF4ZXMgPSBUUlVFKQ0KYGBgDQoNCg0KVGhlIG1vZGVsIGFib3ZlIHdhcyBhYmxlIHRvIGV4cGxhaW4gdGhlIGRpZmZlcmVuY2UgYmV0d2VlbiB0aGUgdHdvIGNsYXNzZXMgd2l0aCBhbiBhY2N1cmFjeSBvZiA2Ny43JS4gSXQgaGFzIGEgc2xpZ2h0bHkgbG93IHNwZWNpZmljaXR5ICgwLjU4KSB0byBkZXRlY3QgYGd1dHR1cmFsc2AsIGJ1dCBhIGZsaWdodHkgaGlnaCBzZW5zaXRpdml0eSAoMC43NSkgdG8gcmVqZWN0IHRoZSBgbm9uLWd1dHR1cmFsc2AuIExvb2tpbmcgYXQgdGhlIGNvbmZ1c2lvbiBtYXRyaXgsIHdlIG9ic2VydmUgdGhhdCBib3RoIGdyb3VwcyB3ZXJlIHJlbGF0aXZlbHkgYWNjdXJhdGVseSBpZGVudGlmaWVkLCBidXQgd2UgaGF2ZSByZWxhdGl2ZWx5IGxhcmdlIGVycm9ycyAob3IgY29uZnVzaW9ucykuIFRoZSBBVUMgaXMgYXQgMC42Nywgd2hpY2ggaXMgbm90IHRvbyBoaWdoLiANCg0KTGV0J3MgY29udGludWUgd2l0aCBHTE0gdG8gZXZhbHVhdGUgaXQgZnVydGhlci4gV2Ugc3RhcnQgYnkgcnVubmluZyBhIGNvcnJlbGF0aW9uIHRlc3QgdG8gZXZhbHVhdGUgaXNzdWVzIHdpdGggR0xNLg0KDQojIyMgQ29ycmVsYXRpb24gdGVzdHMNCg0KYGBge3J9DQpjb3JyIDwtIGNvcihkZlBoYXJWMlstMV0pDQpjb2wgPC0gY29sb3JSYW1wUGFsZXR0ZShjKCJyZWQiLCAid2hpdGUiLCAiYmx1ZSIpKSgyMCkNCmNvcnJwbG90KGNvcnIsIHR5cGUgPSAidXBwZXIiLCBvcmRlciA9ICJoY2x1c3QiLCBjb2wgPSBjb2wpDQpgYGANCg0KDQpUaGUgY29ycmVsYXRpb24gcGxvdCBhYm92ZSBzaG93cyB3aGljaCBwcmVkaWN0b3JzIGFyZSBjb3JyZWxhdGVkIHdpdGggZWFjaCBvdGhlciAocG9zaXRpdmVseSBvciBuZWdhdGl2ZWx5KS4gVGhleSBhcmUgb3JnYW5pc2VkIGJ5IGhpZXJhcmNoaWNhbCBjbHVzdGVyaW5nIHRoYXQgaWRlbnRpZmllcyBjbHVzdGVycyBvZiBwcmVkaWN0b3JzIGNvcnJlbGF0ZWQgd2l0aCBlYWNoIG90aGVyLiANCg0KIyMjIyBDb3JyZWxhdGlvbiB0ZXN0cw0KDQoNCkJlbG93LCB3ZSBsb29rIGF0IHR3byBwcmVkaWN0b3JzIHRoYXQgYXJlIGNvcnJlbGF0ZWQgd2l0aCBlYWNoIG90aGVyOiAgYFozLVoyYCAoRjMtRjIgaW4gQmFyaykgYW5kIGBBMiotQTMqYCAobm9ybWFsaXNlZCBhbXBsaXR1ZGUgZGlmZmVyZW5jZXMgYmV0d2VlbiBoYXJtb25pY3MgY2xvc2VzdCB0byBGMiBhbmQgRjMpLiBUaGUgcmVzdWx0cyBvZiB0aGUgY29ycmVsYXRpb24gdGVzdCBzaG93cyB0aGUgdHdvIHByZWRpY3RvcnMgdG8gbmVnYXRpdmVseSBjb3JyZWxhdGUgd2l0aCBlYWNoIG90aGVyIGF0IGEgcmF0ZSBvZiAtMC44Ny4NCg0KDQoNCmBgYHtyfQ0KY29yLnRlc3QoZGZQaGFyVjIkWjNtbloyLCBkZlBoYXJWMiRBMm1uQTMpDQpgYGANCg0KDQojIyMjIFBsb3RzIHRvIHZpc3VhbGlzZSB0aGUgZGF0YQ0KDQpgYGB7cn0NCmRmUGhhclYyICU+JSANCiAgZ2dwbG90KGFlcyh4ID0gY29udGV4dCwgeSA9IFozbW5aMikpICsgDQogIGdlb21fYm94cGxvdCgpDQoNCmRmUGhhclYyICU+JSANCiAgZ2dwbG90KGFlcyh4ID0gY29udGV4dCwgeSA9IEEybW5BMykpICsgDQogIGdlb21fYm94cGxvdCgpICANCmBgYA0KDQoNCg0KQXMgd2Ugc2VlIGZyb20gdGhlIHBsb3QsIGBaMy1aMmAgaXMgaGlnaGVyIGluIHRoZSBndXR0dXJhbCwgd2hlcmVhcyAgYEEyKi1BMypgIGlzIGxvd2VyLiANCg0KIyMjIyBHTE0gb24gY29ycmVsYXRlZCBkYXRhDQoNCg0KTGV0J3MgcnVuIGEgbG9naXN0aWMgcmVncmVzc2lvbiBhcyBhIGNsYXNzaWZpY2F0aW9uIHRvb2wgdG8gcHJlZGljdCB0aGUgIGNvbnRleHQgYXMgYSBmdW5jdGlvbiBvZiBlYWNoIHByZWRpY3RvciBzZXBhcmF0ZWx5IGFuZCB0aGVuIGNvbWJpbmVkLiANCg0KYGBge3J9DQpkZlBoYXJWMiAlPiUgZ2xtKGNvbnRleHQgfiBaM21uWjIsIGRhdGEgPSAuLCBmYW1pbHkgPSBiaW5vbWlhbCkgJT4lIHN1bW1hcnkoKQ0KDQpkZlBoYXJWMiAlPiUgZ2xtKGNvbnRleHQgfiBBMm1uQTMsIGRhdGEgPSAuLCBmYW1pbHkgPSBiaW5vbWlhbCkgJT4lIHN1bW1hcnkoKQ0KDQpkZlBoYXJWMiAlPiUgZ2xtKGNvbnRleHQgfiBaM21uWjIgKyBBMm1uQTMsIGRhdGEgPSAuLCBmYW1pbHkgPSBiaW5vbWlhbCkgJT4lIHN1bW1hcnkoKQ0KYGBgDQoNCg0KDQpXaGVuIGxvb2tpbmcgYXQgdGhlIHRocmVlIG1vZGVscyBhYm92ZSwgaXQgaXMgY2xlYXIgdGhhdCB0aGUgbG9nb2RkIHZhbHVlIGZvciBgWjMtWjJgIGlzIHBvc2l0aXZlLCB3aGVyZWFzIGl0IGlzIG5lZ2F0aXZlIGZvciBgQTIqLUEzKmAuIFdoZW4gYWRkaW5nIHRoZSB0d28gcHJlZGljdG9ycyB0b2dldGhlciwgdGhlcmUgaXMgY2xlYXIgKipzdXBwcmVzc2lvbioqOiB0aGUgY29lZmZpY2llbnRzIGZvciBib3RoIHByZWRpY3RvcnMgYXJlIG5vdyBuZWdhdGl2ZS4gVGhlIHJlbGF0aXZlbHkgaGlnaCBjb3JyZWxhdGlvbiBiZXR3ZWVuIHRoZSBwcmVkaWN0b3JzIGFmZmVjdGVkIHRoZSBjb2VmZmljaWVudHMgYW5kIGNoYW5nZWQgdGhlIGRpcmVjdGlvbiBvZiB0aGUgc2xvcGU7IGNvbGxpbmVhcml0eSBpcyBoYXJtZnVsIGZvciBhbnkgcmVncmVzc2lvbiBhbmFseXNpcy4gDQoNCkluIHRoZSBmb2xsb3dpbmcsIHdlIGludHJvZHVjZSBkZWNpc2lvbiB0cmVlcyBmb2xsb3dlZCBieSBSYW5kb20gRm9yZXN0IGFzIGEgd2F5IHRvIGRlYWwgd2l0aCBjb2xsaW5lYXJpdHkgYW5kIHRvIG1ha2Ugc2Vuc2Ugb2YgbXVsdGl2YXJpYXRlIHByZWRpY3RvcnMuIA0KDQojIERlY2lzaW9uIFRyZWVzIA0KDQpEZWNpc2lvbiB0cmVlcyBhcmUgYSBzdGF0aXN0aWNhbCB0b29sIHRoYXQgdXNlcyB0aGUgY29tYmluYXRpb24gb2YgcHJlZGljdG9ycyB0byBpZGVudGlmeSBwYXR0ZXJucyBpbiB0aGUgZGF0YSBhbmQgcHJvdmlkZXMgY2xhc3NpZmljYXRpb24gYWNjdXJhY3kgZm9yIHRoZSBtb2RlbC4gDQoNClRoZSBkZWNpc2lvbiB0cmVlIHVzZWQgaXMgYmFzZWQgb24gYGNvbmRpdGlvbmFsIGluZmVyZW5jZSB0cmVlc2AgdGhhdCBsb29rcyBhdCBlYWNoIHByZWRpY3RvciBhbmQgc3BsaXRzIHRoZSBkYXRhIGludG8gbXVsdGlwbGUgbm9kZXMgKGJyYW5jaGVzKSB0aHJvdWdoIHJlY3Vyc2l2ZSBwYXJ0aXRpb25pbmcgaW4gYSBgdHJlZS1zdHJ1Y3R1cmVkIHJlZ3Jlc3Npb24gbW9kZWxgLiBFYWNoIG5vZGUgaXMgYWxzbyBzcGxpdCBpbnRvIGxlYXZlcyAoZGlmZmVyZW5jZSBiZXR3ZWVuIGxldmVscyBvZiBvdXRjb21lKS4NCg0KRGVjaXNpb24gdHJlZXMgdmlhIGBjdHJlZWAgZG9lcyB0aGUgZm9sbG93aW5nOiANCg0KMS4gVGVzdCBnbG9iYWwgbnVsbCBoeXBvdGhlc2lzIG9mIGluZGVwZW5kZW5jZSBiZXR3ZWVuIHByZWRpY3RvcnMgYW5kIG91dGNvbWUuIA0KMi4gU2VsZWN0IHRoZSBwcmVkaWN0b3Igd2l0aCB0aGUgc3Ryb25nZXN0IGFzc29jaWF0aW9uIHdpdGggdGhlIG91dGNvbWUgbWVhc3VyZWQgYmFzZWQgb24gYSBtdWx0aXBsaWNpdHkgYWRqdXN0ZWQgcC12YWx1ZXMgd2l0aCBCb25mZXJyb25pIGNvcnJlY3Rpb24NCjMuIEltcGxlbWVudCBhIGJpbmFyeSBzcGxpdCBpbiB0aGUgc2VsZWN0ZWQgaW5wdXQgdmFyaWFibGUuIA0KNC4gUmVjdXJzaXZlbHkgcmVwZWF0IHN0ZXBzIDEpLCAyKS4gYW5kIDMpLg0KDQpMZXQncyBzZWUgdGhpcyBpbiBhbiBleGFtcGxlIHVzaW5nIHRoZSBzYW1lIGRhdGFzZXQuIFRvIHVuZGVyc3RhbmQgd2hhdCB0aGUgZGVjaXNpb24gdHJlZSBpcyBkb2luZywgd2Ugd2lsbCBkaXNzZWN0IGl0LCBieSBjcmVhdGluZyBvbmUgdHJlZSB3aXRoIG9uZSBwcmVkaWN0b3IgYW5kIG1vdmUgdG8gdGhlIG5leHQuDQoNCg0KIyMgSW5kaXZpZHVhbCB0cmVlcw0KDQojIyMgVHJlZSAxDQoNCmBgYHtyfQ0KIyMgZnJvbSB0aGUgcGFja2FnZSBwYXJ0eQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KdHJlZTEgPC0gZGZQaGFyVjIgJT4lIA0KICBjdHJlZSgNCiAgICBjb250ZXh0IH4gWjJtbloxLCANCiAgICBkYXRhID0gLikNCnByaW50KHRyZWUxKQ0KcGxvdCh0cmVlMSwgbWFpbiA9ICJDb25kaXRpb25hbCBJbmZlcmVuY2UgVHJlZSAiKQ0KYGBgDQoNCg0KSG93IHRvIGludGVycHJldCB0aGlzIGZpZ3VyZT8gTGV0J3MgbG9vayBhdCBtZWFuIHZhbHVlcyBhbmQgYSBwbG90IGZvciB0aGlzIHZhcmlhYmxlLiBUaGlzIGlzIHRoZSBkaWZmZXJlbmNlIGJldHdlZW4gYEYyYCBhbmQgYEYxYCB1c2luZyB0aGUgYmFyayBzY2FsZS4gQmVjYXVzZSBndXR0dXJhbHMgYXJlIHByb2R1Y2VkIHdpdGhpbiB0aGUgcGhhcnlueCAocmVnYXJkbGVzcyBvZiB3aGVyZSksIHRoZSBwcmVkaWN0aW9ucyBpcyB0aGF0IGEgaGlnaCBgRjFgIGFuZCBhIGxvdyBgRjJgIHdpbGwgYmUgdGhlIGFjb3VzdGljIGNvcnJlbGF0ZXMgcmVsYXRlZCB0byB0aGlzIGNvbnN0cmljdGlvbiBsb2NhdGlvbi4gVGhlIGNsb3NlbmVzcyBiZXR3ZWVuIHRoZXNlIGZvcm1hbnRzIHlpZWxkcyBhIGxvd2VyIGBaMi1aMWAuIEhlbmNlLCB0aGUgcHJlZGljdGlvbiBpcyBhcyBmb2xsb3c6IHRoZSBzbWFsbGVyIHRoZSBkaWZmZXJlbmNlLCB0aGUgbW9yZSBwaGFyeW5nZWFsLWxpa2UgY29uc3RyaWN0aW9uIHRoZXNlIGNvbnNvbmFudHMgaGF2ZSAoYWxsIGVsc2UgYmVpbmcgZXF1YWwhKS4gTGV0J3MgY29tcHV0ZSB0aGUgbWVhbi9tZWRpYW4gYW5kIHBsb3QgdGhlIGRpZmZlcmVuY2UgYmV0d2VlbiB0aGUgdHdvIGNvbnRleHRzLg0KDQpgYGB7cn0NCmRmUGhhclYyICU+JSANCiAgZ3JvdXBfYnkoY29udGV4dCkgJT4lIA0KICBzdW1tYXJpc2UobWVhbiA9IG1lYW4oWjJtbloxKSwNCiAgICAgICAgICAgIG1lZGlhbiA9IG1lZGlhbihaMm1uWjEpLCANCiAgICAgICAgICAgIGNvdW50ID0gbigpKQ0KDQpkZlBoYXJWMiAlPiUgDQogIGdncGxvdChhZXMoeCA9IGNvbnRleHQsIHkgPSBaMm1uWjEpKSArIA0KICBnZW9tX2JveHBsb3QoKSAgDQpgYGANCg0KDQpUaGUgdGFibGUgYWJvdmUgcmVwb3J0cyB0aGUgbWVhbiBhbmQgbWVkaWFuIG9mIGBaMi1aMWAgZm9yIGJvdGggbGV2ZWxzIG9mIGNvbnRleHQgYW5kIHRoZSBwbG90cyBzaG93IHRoZSBkaWZmZXJlbmNlIGJldHdlZW4gdGhlIHR3by4gV2UgaGF2ZSBhIHRvdGFsIG9mIDE4MCBjYXNlcyBpbiB0aGUgYGd1dHR1cmFsYCwgYW5kIDIyMiBpbiB0aGUgYG5vbi1ndXR0dXJhbGAuIA0KV2hlbiBjb25zaWRlcmluZyB0aGUgY29uZGl0aW9uYWwgaW5mZXJlbmNlIHRyZWUgb3V0cHV0LCB2YXJpb3VzIHNwbGl0cyB3ZXJlIG9idGFpbmVkLiANClRoZSBmaXJzdCBpcyBhbnkgdmFsdWUgaGlnaGVyIHRoYW4gOS41NSBiZWluZyBhc3NpZ25lZCB0byB0aGUgYG5vbi1ndXR0dXJhbGAgY2xhc3MgKGFyb3VuZCA5OCUgb2YgNzUgY2FzZXMpDQpUaGVuLCB3aXRoIGFueXRoaW5nIGxvd2VyIHRoYW4gOS41NSwgYSBzZWNvbmQgc3BsaXQgd2FzIG9idGFpbmVkLiBBIHRocmVzaG9sZCBvZiA2Ljc4OiBoaWdoZXIgYXNzaWduZWQgdG8gYGd1dHR1cmFsYCAoYXJvdW5kIDk4JSBvZiA2NCBjYXNlcyksIGxvd2VyLCB3ZXJlIHNwbGl0IGFnYWluIHdpdGggYSB0aHJlc2hvbGQgb2YgNCBCYXJrLiBBIHRoaXJkIHNwbGl0IHdhcyBvYnRhaW5lZDogdmFsdWVzIGxvd2VyIG9mIGVxdWFsIHRvIDQgQmFyayBhcmUgYXNzaWduZWQgdG8gdGhlIGBndXR0dXJhbGAgKGFyb3VuZCA3MCUgb2YgMTU3IGNhc2VzKSBhbmQgdmFsdWVzIGhpZ2hlciB0aGFuIDQgQmFya3MgYXNzaWduZWQgdG8gdGhlIGBub24tZ3V0dHVyYWxgIChhcm91bmQgOTAlIG9mIDEwNiBjYXNlcykuDQoNCkRpc3NlY3RpbmcgdGhlIHRyZWUgbGlrZSB0aGlzIGFsbG93cyBpbnRlcnByZXRhdGlvbiBvZiB0aGUgb3V0cHV0LiBJbiB0aGlzIGV4YW1wbGUsIHRoaXMgaXMgcXVpdGUgYSBjb21wbGV4IGNhc2UgYW5kIGBjdHJlZWAgYWxsb3dlZCB0byBmaW5lIHR1bmUgdGhlIGRpZmZlcmVudCBwYXR0ZXJucyBzZWVuIHdpdGggDQpOb3cgbGV0J3MgbG9vayBhdCB0aGUgZnVsbCBkYXRhc2V0IHRvIG1ha2Ugc2Vuc2Ugb2YgdGhlIGNvbWJpbmF0aW9uIG9mIHByZWRpY3RvcnMgdG8gdGhlIGRpZmZlcmVuY2UuIA0KDQojIyBNb2RlbCAxDQoNCiMjIyBNb2RlbCBzcGVjaWZpY2F0aW9uDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KZml0IDwtIGRmUGhhclYyICAlPiUgDQogIGN0cmVlKA0KICAgIGNvbnRleHQgfiAuLCANCiAgICBkYXRhID0gLikNCnByaW50KGZpdCkNCnBsb3QoZml0LCBtYWluID0gIkNvbmRpdGlvbmFsIEluZmVyZW5jZSBUcmVlIikNCmBgYA0KDQoNCkhvdyB0byBpbnRlcnByZXQgdGhpcyBjb21wbGV4IGRlY2lzaW9uIHRyZWU/IA0KDQpMZXQncyBvYnRhaW4gdGhlIG1lZGlhbiB2YWx1ZSBmb3IgZWFjaCBwcmVkaWN0b3IgZ3JvdXBlZCBieSBjb250ZXh0LiBEaXNjdXNzIHNvbWUgb2YgdGhlIHBhdHRlcm5zLiANCg0KYGBge3J9DQpkZlBoYXJWMiAlPiUgDQogIGdyb3VwX2J5KGNvbnRleHQpICU+JSANCiAgc3VtbWFyaXplX2FsbChsaXN0KG1lYW4gPSBtZWFuKSkNCmBgYA0KDQoNCg0KV2Ugc3RhcnRlZCB3aXRoIGBjb250ZXh0YCBhcyBvdXIgb3V0Y29tZSwgYW5kIGFsbCAyMyBhY291c3RpYyBtZWFzdXJlcyBhcyBwcmVkaWN0b3JzLiBBIHRvdGFsIG9mIDggdGVybWluYWwgbm9kZXMgd2VyZSBpZGVudGlmaWVkIHdpdGggbXVsdGlwbGUgYmluYXJ5IHNwbGl0cyBpbiB0aGVpciBsZWF2ZXMsIGFsbG93aW5nIHNlcGFyYXRpb24gb2YgdGhlIHR3byBjYXRlZ29yaWVzLiBMb29raW5nIHNwZWNpZmljYWxseSBhdCB0aGUgb3V0cHV0LCB3ZSBvYnNlcnZlIGEgZmV3IHRoaW5ncy4NCg0KVGhlIGZpcnN0IG5vZGUgd2FzIGJhc2VkIG9uIGBBMiotQTMqYCwgZGV0ZWN0aW5nIGEgZGlmZmVyZW5jZSBiZXR3ZWVuIG5vbi1ndXR0dXJhbHMgYW5kIGd1dHR1cmFscy4gRm9yIHRoZSBmaXJzdCBiaW5hcnkgc3BsaXQsIGEgdGhyZXNob2xkIG9mIC0xMy43OCBCYXJrIHdhcyB1c2VkIChtZWFuIG5vbiBndXR0dXJhbCA9IC03Ljg2OyBtZWFuIGd1dHR1cmFsID0gLTE0LjU4KSwgdGhlbiBmb3IgdmFsdWVzIGxvd2VyIG9mIGVxdWFsIHRvIHRoaXMgdGhyZXNob2xkLCBhIHNlY29uZCBzcGxpdCB3YXMgcGVyZm9ybWVkIHVzaW5nIGBaNC1aM2AgKG1lYW4gbm9uIGd1dHR1cmFsID0gMS42NzsgbWVhbiBndXR0dXJhbCA9IDEuNDMpIHdpdGggYW55IHZhbHVlIHNtYWxsZXIgYW5kIGVxdWFsIHRvIDEuNTksIHRoZW4gYW5vdGhlciBiaW5hcnkgc3BsaXQgdXNpbmcgYEgyKi1INCpgLCBldGMuLi4NCg0KT25jZSBkb25lLCB0aGUgYGN0cmVlYCBwcm92aWRlcyBtdWx0aXBsZSBiaW5hcnkgc3BsaXRzIGludG8gZ3V0dHVyYWwgb3Igbm9uLWd1dHR1cmFsLiANCg0KQW55IHBvc3NpYmxlIGlzc3Vlcy9pbnRlcmVzdGluZyBwYXR0ZXJucyB5b3UgY2FuIGlkZW50aWZ5PyBMb29rIGF0IHRoZSBpbnRlcmFjdGlvbnMgYmV0d2VlbiBwcmVkaWN0b3JzLiANCg0KDQojIyMgUHJlZGljdGlvbnMgZnJvbSB0aGUgZnVsbCBtb2RlbA0KDQpMZXQncyBvYnRhaW4gc29tZSBwcmVkaWN0aW9ucyBmcm9tIHRoZSBtb2RlbCBhbmQgZXZhbHVhdGUgaG93IHN1Y2Nlc3NmdWwgaXQgaXMgaW4gZGVhbGluZyB3aXRoIHRoZSBkYXRhLiANCg0KYGBge3J9DQpzZXQuc2VlZCgxMjM0NTYpDQpwcmVkLmN0cmVlIDwtIHByZWRpY3QoZml0KQ0KdGJsLmN0cmVlIDwtIHRhYmxlKHByZWQuY3RyZWUsIGRmUGhhclYyJGNvbnRleHQpDQp0YmwuY3RyZWUNClByZXNlbmNlQWJzZW5jZTo6cGNjKHRibC5jdHJlZSkNClByZXNlbmNlQWJzZW5jZTo6c3BlY2lmaWNpdHkodGJsLmN0cmVlKQ0KUHJlc2VuY2VBYnNlbmNlOjpzZW5zaXRpdml0eSh0YmwuY3RyZWUpDQoNCnJvYy5jdHJlZSA8LSBwUk9DOjpyb2MoZGZQaGFyVjIkY29udGV4dCwgYXMubnVtZXJpYyhwcmVkLmN0cmVlKSkNCnJvYy5jdHJlZQ0KcFJPQzo6cGxvdC5yb2Mocm9jLmN0cmVlLCBsZWdhY3kuYXhlcyA9IFRSVUUpDQpgYGANCg0KVGhpcyBmdWxsIG1vZGVsIGhhcyBhIGNsYXNzaWZpY2F0aW9uIGFjY3VyYWN5IG9mIDgyLjglLlRoaXMgaXMgbm90IGJhZCEhIEl0IGhhcyBhIHJlbGF0aXZlbHkgbW9kZXJhdGUgc3BlY2lmaWNpdHkgYXQgMC43NyAoYXQgZGV0ZWN0aW5nIHRoZSBndXR0dXJhbHMpIGJ1dCBhIGhpZ2ggc2Vuc2l0aXZpdHkgYXQgMC44NyAoYXQgZGV0ZWN0aW5nIHRoZSBub24tZ3V0dHVyYWxzKS4gVGhlIFJPQyBjdXJ2ZSBzaG93cyB0aGUgcmVsYXRpb25zaGlwIGJldHdlZW4gdGhlIHR3byB3aXRoIGFuIEFVQyBvZiAwLjgyMw0KDQoNCiMjIFVwIHRvIHlvdS4uDQoNClRyeSBhbmQgZml0IHR3byBkZWNpc2lvbiB0cmVlcywgdGhlIGZpcnN0IG9uIGJhcmsgZGlmZmVyZW5jZSBtZXRyaWNzIGFuZCB0aGUgc2Vjb25kIG9uIHZvaWNlIHF1YWxpdHkgbWV0cmljcy4gVXNlIHRoZSBgdGlkeXZlcnNlYCBhcHByb2FjaCB0byAxKSBzZWxlY3QgcHJlZGljdG9ycyBhbmQgMikgdG8gcnVuIGN0cmVlLiANCg0KQW5zd2VyIGJlbG93ISENCg0KYGBge3J9DQojIGZvcm1hbnRzDQpgYGANCg0KDQoNCg0KDQpgYGB7cn0NCiMgVm9pY2UgcXVhbGl0eQ0KYGBgDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KYGBge3J9DQojIGNyZWF0ZSB0d28gZGF0YXNldHMNCmRmRm9ybSA8LSBkZlBoYXJWMiAgJT4lIA0KICBzZWxlY3QoLiwgImNvbnRleHQiLCAiWjFtblowIiwgIloybW5aMSIsICJaM21uWjIiLCAiWjRtblozIikNCg0KZGZWUSA8LSBkZlBoYXJWMiAgJT4lIA0KICBzZWxlY3QoLiwgImNvbnRleHQiLCBjKDI6MTYsIDIxOjI0KSkNCg0KDQpzZXQuc2VlZCgxMjM0NTYpDQojIEZvcm1hbnRzDQpmaXRGb3JtIDwtIGRmRm9ybSAgJT4lIA0KICBjdHJlZSgNCiAgICBjb250ZXh0IH4gLiwgDQogICAgZGF0YSA9IC4pDQpwcmludChmaXRGb3JtKQ0KcGxvdChmaXRGb3JtKQ0KIyBwcmVkaWN0aW9ucw0KcHJlZC5jdHJlZS5Gb3JtIDwtIHByZWRpY3QoZml0Rm9ybSkNCnRibC5jdHJlZS5Gb3JtIDwtIHRhYmxlKHByZWQuY3RyZWUuRm9ybSwgZGZGb3JtJGNvbnRleHQpDQp0YmwuY3RyZWUuRm9ybQ0KUHJlc2VuY2VBYnNlbmNlOjpwY2ModGJsLmN0cmVlLkZvcm0pDQpQcmVzZW5jZUFic2VuY2U6OnNwZWNpZmljaXR5KHRibC5jdHJlZS5Gb3JtKQ0KUHJlc2VuY2VBYnNlbmNlOjpzZW5zaXRpdml0eSh0YmwuY3RyZWUuRm9ybSkNCnJvYy5jdHJlZS5Gb3JtIDwtIHBST0M6OnJvYyhkZkZvcm0kY29udGV4dCwgYXMubnVtZXJpYyhwcmVkLmN0cmVlLkZvcm0pKQ0Kcm9jLmN0cmVlLkZvcm0NCnBST0M6OnBsb3Qucm9jKHJvYy5jdHJlZS5Gb3JtLCBsZWdhY3kuYXhlcyA9IFRSVUUpDQoNCnNldC5zZWVkKDEyMzQ1NikNCiMgVlENCmZpdFZRIDwtIGRmVlEgICU+JSANCiAgY3RyZWUoDQogICAgY29udGV4dCB+IC4sIA0KICAgIGRhdGEgPSAuKQ0KcHJpbnQoZml0VlEpDQpwbG90KGZpdFZRKQ0KIyBwcmVkaWN0aW9ucw0KcHJlZC5jdHJlZS5WUSA8LSBwcmVkaWN0KGZpdFZRKQ0KdGJsLmN0cmVlLlZRIDwtIHRhYmxlKHByZWQuY3RyZWUuVlEsIGRmVlEkY29udGV4dCkNCnRibC5jdHJlZS5WUQ0KUHJlc2VuY2VBYnNlbmNlOjpwY2ModGJsLmN0cmVlLlZRKQ0KUHJlc2VuY2VBYnNlbmNlOjpzcGVjaWZpY2l0eSh0YmwuY3RyZWUuVlEpDQpQcmVzZW5jZUFic2VuY2U6OnNlbnNpdGl2aXR5KHRibC5jdHJlZS5WUSkNCnJvYy5jdHJlZS5WUSA8LSBwUk9DOjpyb2MoZGZWUSRjb250ZXh0LCBhcy5udW1lcmljKHByZWQuY3RyZWUuVlEpKQ0Kcm9jLmN0cmVlLlZRDQpwUk9DOjpwbG90LnJvYyhyb2MuY3RyZWUuVlEsIGxlZ2FjeS5heGVzID0gVFJVRSkNCmBgYA0KDQoNCg0KDQoNCiMjIFJhbmRvbSBzZWxlY3Rpb24NCg0KT25lIGltcG9ydGFudCBpc3N1ZSBpcyB0aGF0IHRoZSB0cmVlcyB3ZSBncmV3IGFib3ZlIGFyZSBiaWFzZWQuIFRoZXkgYXJlIGJhc2VkIG9uIHRoZSBmdWxsIGRhdGFzZXQsIHdoaWNoIG1lYW5zIHRoZXkgYXJlIHZlcnkgbGlrZWx5IHRvIG92ZXJmaXQgdGhlIGRhdGEuIFdlIGRpZCBub3QgYWRkIGFueSByYW5kb20gc2VsZWN0aW9uIGFuZCB3ZSBvbmx5IGdyZXcgb25lIHRyZWUgZWFjaCB0aW1lLiBJZiB5b3UgdGhpbmsgYWJvdXQgaXQsIGlzIGl0IHBvc3NpYmxlIHRoYXQgd2Ugb2J0YWluZWQgc3VjaCByZXN1bHRzIHNpbXBseSBieSBjaGFuY2U/IA0KDQpXaGF0IGlmIHdlIGFkZCBzb21lIHJhbmRvbW5lc3MgaW4gdGhlIHByb2Nlc3Mgb2YgY3JlYXRpbmcgYSBjb25kaXRpb25hbCBpbmZlcmVuY2UgdHJlZT8NCg0KDQpXZSBjaGFuZ2UgYSBzbWFsbCBvcHRpb24gaW4gYGN0cmVlYCB0byBhbGxvdyBmb3IgcmFuZG9tIHNlbGVjdGlvbiBvZiB2YXJpYWJsZXMsIHRvIG1pbWljIHdoYXQgUmFuZG9tIEZvcmVzdHMgd2lsbCBkby4gV2UgdXNlIGBjb250cm9sc2AgdG8gc3BlY2lmeSBgbXRyeSA9IDVgLCB3aGljaCBpcyB0aGUgcm91bmRlZCBzcXVhcmUgcm9vdCBvZiBudW1iZXIgb2YgcHJlZGljdG9ycy4gDQoNCg0KIyMjIE1vZGVsIDINCg0KYGBge3J9DQpzZXQuc2VlZCgxMjM0NTYpDQpmaXQxIDwtIGRmUGhhclYyICAlPiUgDQogIGN0cmVlKA0KICAgIGNvbnRleHQgfiAuLCANCiAgICBkYXRhID0gLiwNCiAgICBjb250cm9scyA9IGN0cmVlX2NvbnRyb2wobXRyeSA9IDUpKQ0KcGxvdChmaXQxLCBtYWluID0gIkNvbmRpdGlvbmFsIEluZmVyZW5jZSBUcmVlIikNCnByZWQuY3RyZWUxIDwtIHByZWRpY3QoZml0MSkNCnRibC5jdHJlZTEgPC0gdGFibGUocHJlZC5jdHJlZTEsIGRmUGhhclYyJGNvbnRleHQpDQp0YmwuY3RyZWUxDQpQcmVzZW5jZUFic2VuY2U6OnBjYyh0YmwuY3RyZWUxKQ0KUHJlc2VuY2VBYnNlbmNlOjpzcGVjaWZpY2l0eSh0YmwuY3RyZWUxKQ0KUHJlc2VuY2VBYnNlbmNlOjpzZW5zaXRpdml0eSh0YmwuY3RyZWUxKQ0KDQpyb2MuY3RyZWUxIDwtIHBST0M6OnJvYyhkZlBoYXJWMiRjb250ZXh0LCBhcy5udW1lcmljKHByZWQuY3RyZWUxKSkNCnJvYy5jdHJlZTENCnBST0M6OnBsb3Qucm9jKHJvYy5jdHJlZTEsIGxlZ2FjeS5heGVzID0gVFJVRSkNCmBgYA0KDQoNCkNhbiB5b3UgY29tcGFyZSByZXN1bHRzIGJldHdlZW4geW91IGFuZCBkaXNjdXNzIHdoYXQgaXMgZ29pbmcgb24/IA0KDQpXaGVuIGFkZGluZyBvbmUgcmFuZG9tIHNlbGVjdGlvbiBwcm9jZXNzIHRvIG91ciBgY3RyZWVgLCB3ZSBhbGxvdyBpdCB0byBvYnRhaW4gbW9yZSByb2J1c3QgcHJlZGljdGlvbnMuIFdlIGNvdWxkIGV2ZW4gZ28gZnVydGhlciBhbmQgZ3JvdyBtdWx0aXBsZSBzbWFsbCB0cmVlcyB3aXRoIGEgcG9ydGlvbiBvZiBkYXRhcG9pbnRzIChlLmcuLCAxMDAgcm93cywgMjAwIHJvd3MpLiBXaGVuIGRvaW5nIHRoZXNlIG11bHRpcGxlIHJhbmRvbSBzZWxlY3Rpb25zLCB5b3UgYXJlIGdyb3dpbmcgbXVsdGlwbGUgdHJlZXMgdGhhdCBhcmUgZGVjb3JyZWxhdGVkIGZyb20gZWFjaCBvdGhlci4gVGhlc2UgYmVjb21lIGluZGVwZW5kZW50IHRyZWVzIGFuZCBvbmUgY2FuIGNvbWJpbmUgdGhlIHJlc3VsdHMgb2YgdGhlc2UgdHJlZXMgdG8gY29tZSB3aXRoIGNsZWFyIHByZWRpY3Rpb25zLiANCg0KVGhpcyBpcyBob3cgUmFuZG9tIEZvcmVzdHMgd29yay4gWW91IHdvdWxkIHN0YXJ0IGZyb20gYSBkYXRhc2V0LCB0aGVuIGdyb3cgbXVsdGlwbGUgdHJlZXMsIHZhcnkgbnVtYmVyIG9mIG9ic2VydmF0aW9ucyB1c2VkIChucm93KSwgYW5kIG51bWJlciBvZiBwcmVkaWN0b3JzIHVzZWQgKG10cnkpLCBhZGp1c3QgYnJhbmNoZXMsIGFuZCBkZXB0aCBvZiBub2RlcyBhbmQgYXQgdGhlIGVuZCwgY29tYmluZSB0aGUgcmVzdWx0cyBpbiBhIGZvcmVzdC4gWW91IGNhbiBhbHNvIHJ1biBwZXJtdXRhdGlvbiB0ZXN0cyB0byBldmFsdWF0ZSBjb250cmlidXRpb25zIG9mIGVhY2ggcHJlZGljdG9yIHRvIHRoZSBvdXRjb21lLiBUaGlzIGlzIHRoZSBiZWF1dHkgb2YgUmFuZG9tIEZvcmVzdHMuIFRoZXkgZG8gYWxsIG9mIHRoZXNlIHN0ZXBzIGF1dG9tYXRpY2FsbHkgYXQgb25jZSBmb3IgeW91ISANCg0KDQojIFJhbmRvbSBGb3Jlc3RzDQoNCkFzIHRoZWlyIG5hbWUgaW5kaWNhdGUsIGEgUmFuZG9tIEZvcmVzdCBpcyBhIGZvcmVzdCBvZiB0cmVlcyBpbXBsZW1lbnRlZCB0aHJvdWdoIGJhZ2dpbmcgZW5zZW1ibGUgYWxnb3JpdGhtcy4gRWFjaCB0cmVlIGhhcyBtdWx0aXBsZSBicmFuY2hlcyAobm9kZXMpLCBhbmQgd2lsbCBwcm92aWRlIHByZWRpY3Rpb25zIGJhc2VkIG9uIHJlY3Vyc2l2ZSBwYXJ0aXRpb25pbmcgb2YgdGhlIGRhdGEuIFRoZW4gdXNpbmcgdGhlIHByZWRpY3Rpb25zIGZyb20gdGhlIG11bHRpcGxlIGdyb3duIHRyZWVzLCBSYW5kb20gRm9yZXN0cyB3aWxsIGNyZWF0ZSBgYXZlcmFnZWRgIHByZWRpY3Rpb25zIGFuZCBjb21lIHVwIHdpdGggcHJlZGljdGlvbiBhY2N1cmFjeSwgZXRjLiANCg0KVGhlcmUgYXJlIG11bHRpcGxlIHBhY2thZ2VzIHRoYXQgb25lIGNhbiB1c2UgdG8gZ3JvdyBSYW5kb20gRm9yZXN0czoNCg0KMS4gYHJhbmRvbUZvcmVzdGA6IFRoZSBvcmlnaW5hbCBpbXBsZW1lbnRhdGlvbiBvZiBSYW5kb20gRm9yZXN0cy4NCjIuIGBwYXJ0eWAgYW5kIGBwYXJ0eWtpdGA6IHVzaW5nIGNvbmRpdGlvbmFsIGluZmVyZW5jZSB0cmVlcyBhcyBiYXNlIGxlYXJuZXJzDQozLiBgcmFuZ2VyYDogYSByZWltcGxlbWVudGF0aW9uIG9mIFJhbmRvbSBGb3Jlc3RzOyBmYXN0ZXIgYW5kIG1vcmUgZmxleGlibGUgdGhhbiBvcmlnaW5hbCBpbXBsZW1lbnRhdGlvbg0KDQpUaGUgZmlyc3QgaW1wbGVtZW50YXRpb24gb2YgUmFuZG9tIEZvcmVzdHMgaXMgd2lkZWx5IHVzZWQgaW4gcmVzZWFyY2guIE9uZSBvZiB0aGUgaXNzdWVzIGluIHRoaXMgZmlyc3QgaW1wbGVtZW50YXRpb24gaXMgdGhhdCBpdCBmYXZvdXJlZCBzcGVjaWZpYyB0eXBlcyBvZiBwcmVkaWN0b3JzIChlLmcuLCBjYXRlZ29yaWNhbCBwcmVkaWN0b3JzLCBwcmVkaWN0b3JzIHdpdGggbXVsdGlwbGUgY3V0LW9mZnMsIGV0YykuIFJhbmRvbSBGb3Jlc3RzIGdyb3duIHZpYSBDb25kaXRpb25hbCBJbmZlcmVuY2UgVHJlZXMgYXMgaW1wbGVtZW50ZWQgaW4gYHBhcnR5YCBndWFyZCBhZ2FpbnN0IHRoaXMgYmlhcywgYnV0IHRoZXkgYXJlIGNvbXB1dGF0aW9uYWxseSBkZW1hbmRpbmcuIFJhbmRvbSBGb3Jlc3RzIGdyb3duIHZpYSBwZXJtdXRhdGlvbiB0ZXN0cyBhcyBpbXBsZW1lbnRlZCBpbiBgcmFuZ2VyYCBzcGVlZCB1cCB0aGUgY29tcHV0YXRpb25zIGFuZCBjYW4gbWltaWMgdGhlIHVuYmlhc2VkIHNlbGVjdGlvbiBwcm9jZXNzLiANCg0KIyMgUGFydHkNCg0KUmFuZG9tIEZvcmVzdHMgZ3Jvd24gdmlhIGNvbmRpdGlvbmFsIGluZmVyZW5jZSB0cmVlcywgYXJlIGRpZmZlcmVudCBmcm9tIHRoZSBvcmlnaW5hbCBpbXBsZW1lbnRhdGlvbi4gVGhleSBvZmZlciBhbiB1bmJpYXNlZCBzZWxlY3Rpb24gcHJvY2VzcyB0aGF0IGd1YXJkcyBhZ2FpbnN0IG92ZXJmaXR0aW5nIG9mIHRoZSBkYXRhLiBUaGVyZSBhcmUgdmFyaW91cyBwb2ludHMgd2UgbmVlZCB0byBjb25zaWRlciBpbiBncm93aW5nIHRoZSBmb3Jlc3QsIGluY2x1ZGluZyBudW1iZXIgb2YgdHJlZXMgYW5kIHByZWRpY3RvcnMgdG8gdXNlIGVhY2ggdGltZS4gTGV0IHVzIHJ1biBvdXIgZmlyc3QgUmFuZG9tIEZvcmVzdCB2aWEgY29uZGl0aW9uYWwgaW5mZXJlbmNlIHRyZWVzLiBUbyBtYWtlIHN1cmUgdGhlIGNvZGUgcnVucyBhcyBmYXN0IGFzIGl0IGNhbiwgd2UgdXNlIGEgdmVyeSBsb3cgbnVtYmVyIG9mIHRyZWVzOiBvbmx5IDEwMCBJdCBpcyB3ZWxsIGtub3duIHRoYXQgdGhlIG1vcmUgdHJlZXMgeW91IGdyb3csIHRoZSBtb3JlIGNvbmZpZGVuY2UgeW91IGhhdmUgaW4gdGhlIHJlc3VsdHMsIGFzIG1vZGVsIGVzdGltYXRpb24gd2lsbCBiZSBtb3JlIHN0YWJsZS4gSW4gdGhpcyBleGFtcGxlLCBJIHdvdWxkIGVhc2lseSBnbyB3aXRoIDUwMCB0cmVlcy4uDQoNCiMjIyBNb2RlbCBzcGVjaWZpY2F0aW9uDQoNClRvIGdyb3cgdGhlIGZvcmVzdCwgd2UgdXNlIHRoZSBmdW5jdGlvbiBgY2ZvcmVzdGAuIFdlIHVzZSBhbGwgb2YgdGhlIGRhdGFzZXQgZm9yIHRoZSBtb21lbnQuIFdlIG5lZWQgdG8gc3BlY2lmeSBhIGZldyBvcHRpb25zIHdpdGhpbiBjb250cm9sczogDQoNCjEuIGBudHJlZSA9IDEwMGAgPSBudW1iZXIgb2YgdHJlZXMgdG8gZ3Jvdy4gRGVmYXVsdCA9IDUwMC4NCjIuIGBtdHJ5ID0gcm91bmQoc3FydCgyMykpYDogbnVtYmVyIG9mIHByZWRpY3RvcnMgdG8gdXNlIGVhY2ggdGltZS4gRGVmYXVsdCBpcyA1LCBidXQgc3BlY2lmeWluZyBpdCBpcyBhZHZpc2VkIHRvIGFjY291bnQgZm9yIHRoZSBzdHJ1Y3R1cmUgb2YgdGhlIGRhdGENCg0KQnkgZGVmYXVsdCwgYGNmb3Jlc3RfdW5iaWFzZWRgIGhhcyB0d28gYWRkaXRpb25hbCBpbXBvcnRhbnQgb3B0aW9ucyB0aGF0IGFyZSB1c2VkIGZvciBhbiB1bmJpYXNlZCBzZWxlY3Rpb24gcHJvY2Vzcy4gKipXQVJOSU5HKio6IHlvdSBzaG91bGQgbm90IGNoYW5nZSB0aGVzZSB1bmxlc3MgeW91IGtub3cgd2hhdCB5b3UgYXJlIGRvaW5nLiBBbHNvLCBieSBkZWZhdWx0LCB0aGUgZGF0YSBhcmUgc3BsaXQgaW50byBhIHRyYWluaW5nIGFuZCBhIHRlc3Rpbmcgc2V0LiBUaGUgdHJhaW5pbmcgaXMgZXF1YWwgdG8gMi8zcyBvZiB0aGUgZGF0YTsgdGhlIHRlc3RpbmcgaXMgMS8zLg0KDQoxLiBgcmVwbGFjZSA9IEZBTFNFYCA9IFVzZSBzdWJzYW1wbGluZyB3aXRoIG9yIHdpdGhvdXQgcmVwbGFjZW1lbnQuIERlZmF1bHQgaXMgYEZBTFNFYCwgaS5lLiwgdXNlIHN1YnNldHMgb2YgdGhlIGRhdGEgd2l0aG91dCByZXBsYWNpbmcgdGhlc2UuICANCjIuIGBmcmFjdGlvbiA9IDAuNjMyYCA9IFVzZSA2My4yJSBvZiB0aGUgZGF0YSBpbiBlYWNoIHNwbGl0LiANCg0KDQpgYGB7cn0NCnNldC5zZWVkKDEyMzQ1NikNCm1kbC5jZm9yZXN0IDwtIGRmUGhhclYyICU+JSANCiAgY2ZvcmVzdChjb250ZXh0IH4gLiwgZGF0YSA9IC4sIA0KICAgICAgICAgIGNvbnRyb2xzID0gY2ZvcmVzdF91bmJpYXNlZChudHJlZSA9IDEwMCwgDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG10cnkgPSByb3VuZChzcXJ0KDIzKSkpKQ0KYGBgDQoNCg0KIyMjIFByZWRpY3Rpb25zDQoNClRvIG9idGFpbiBwcmVkaWN0aW9ucyBmcm9tIHRoZSBtb2RlbCwgd2UgdXNlIHRoZSBgcHJlZGljdGAgZnVuY3Rpb24gYW5kIGFkZCBgT09CID0gVFJVRWAuIFRoaXMgdXNlcyB0aGUgb3V0LW9mLWJhZyBzYW1wbGUgKGkuZS4sIDEvMyBvZiB0aGUgZGF0YSkuIA0KDQpgYGB7cn0NCnNldC5zZWVkKDEyMzQ1NikNCnByZWQuY2ZvcmVzdCA8LSBwcmVkaWN0KG1kbC5jZm9yZXN0LCBPT0IgPSBUUlVFKQ0KdGJsLmNmb3Jlc3QgPC0gdGFibGUocHJlZC5jZm9yZXN0LCBkZlBoYXJWMiRjb250ZXh0KQ0KdGJsLmNmb3Jlc3QNClByZXNlbmNlQWJzZW5jZTo6cGNjKHRibC5jZm9yZXN0KQ0KUHJlc2VuY2VBYnNlbmNlOjpzcGVjaWZpY2l0eSh0YmwuY2ZvcmVzdCkNClByZXNlbmNlQWJzZW5jZTo6c2Vuc2l0aXZpdHkodGJsLmNmb3Jlc3QpDQoNCnJvYy5jZm9yZXN0IDwtIHBST0M6OnJvYyhkZlBoYXJWMiRjb250ZXh0LCBhcy5udW1lcmljKHByZWQuY2ZvcmVzdCkpDQpyb2MuY2ZvcmVzdA0KcFJPQzo6cGxvdC5yb2Mocm9jLmNmb3Jlc3QsIGxlZ2FjeS5heGVzID0gVFJVRSkNCmBgYA0KDQpDb21wYXJlZCB3aXRoIHRoZSA4Mi44JSBjbGFzc2lmaWNhdGlvbiBhY2N1cmFjeSB3ZSBvYnRhaW5lZCB1c2luZyBgY3RyZWVgIHVzaW5nIG91ciBmdWxsIGRhdGFzZXQgYWJvdmUgKG1vZGVsIDEpLCBoZXJlIHdlIG9idGFpbiA4NS41JSB3aXRoIGFuIDIuNyUgaW5jcmVhc2UuIENvbXBhcmVkIHdpdGggdGhlIDY3LjQlIGZyb20gbW9kZWwgMiBmcm9tIGBjdHJlZWAgd2l0aCByYW5kb20gc2VsZWN0aW9uIG9mIHByZWRpY3RvcnMsIHdlIGhhdmUgYW4gMTguMSUgaW5jcmVhc2UgaW4gY2xhc3NpZmljYXRpb24gYWNjdXJhY3khDQoNCldlIGNvdWxkIHRlc3Qgd2hldGhlciB0aGVyZSBpcyBzdGF0aXN0aWNhbGx5IHNpZ25pZmljYW50IGRpZmZlcmVuY2UgYmV0d2VlbiBvdXIgYGN0cmVlYCBhbmQgYGNmb3Jlc3RgIG1vZGVscy4gVXNpbmcgdGhlIFJPQyBjdXJ2ZXMsIHRoZSBgcm9jLnRlc3RgIGNvbmR1Y3RzIGEgbm9uLXBhcmFtZXRyaWMgWiB0ZXN0IG9mIHNpZ25pZmljYW5jZSBvbiB0aGUgY29ycmVsYXRlZCBST0MgY3VydmVzLiBUaGUgcmVzdWx0cyBzaG93IGEgc3RhdGlzdGljYWxseSBzaWduaWZpY2FudCBpbXByb3ZlbWVudCB1c2luZyB0aGUgYGNmb3Jlc3RgIG1vZGVsLiBUaGlzIGlzIG5vcm1hbCBiZWNhdXNlIHdlIGFyZSBncm93aW5nIDEwMCBkaWZmZXJlbnQgdHJlZXMsIHdpdGggcmFuZG9tIHNlbGVjdGlvbiBvZiBib3RoIHByZWRpY3RvcnMgYW5kIHNhbXBsZXMgYW5kIHByb3ZpZGUgYW4gYGF2ZXJhZ2VkYCBwcmVkaWN0aW9uLiANCg0KYGBge3J9DQpwUk9DOjpyb2MudGVzdChyb2MuY3RyZWUsIHJvYy5jZm9yZXN0KQ0KcFJPQzo6cm9jLnRlc3Qocm9jLmN0cmVlMSwgcm9jLmNmb3Jlc3QpDQpgYGANCg0KDQojIyMgVmFyaWFibGUgSW1wb3J0YW5jZSBTY29yZXMNCg0KT25lIGltcG9ydGFudCBmZWF0dXJlIGluIGBjdHJlZWAgd2FzIHRvIHNob3cgd2hpY2ggcHJlZGljdG9yIHdhcyB1c2VkIGZpcnN0IGlzIHNwbGl0dGluZyB0aGUgZGF0YSwgd2hpY2ggd2FzIHRoZW4gZm9sbG93ZWQgYnkgdGhlIG90aGVyIHByZWRpY3RvcnMuIFdlIHVzZSBhIHNpbWlsYXIgZnVuY3Rpb25hbGl0eSB3aXRoIGBjZm9yZXN0YCB0byBvYnRhaW4gdmFyaWFibGUgaW1wb3J0YW5jZSBzY29yZXMgdG8gcGlucG9pbnQgYHN0cm9uZ2AgYW5kIGB3ZWFrYCBwcmVkaWN0b3JzLiANCg0KVGhlcmUgYXJlIHR3byB3YXlzIHRvIG9idGFpbiB0aGlzOg0KDQoxLiBTaW1wbGUgcGVybXV0YXRpb24gdGVzdHMgKGNvbmRpdGlvbmFsID0gRkFMU0UpDQoyLiBDb25kaXRpb25hbCBwZXJtdXRhdGlvbiB0ZXN0cyAoY29uZGl0aW9uYWwgPSBUUlVFKQ0KDQpUaGUgZm9ybWVyIGlzIGdlbmVyYWxseSBjb21wYXJhYmxlIGFjcm9zcyBwYWNrYWdlcyBhbmQgcHJvdmlkZXMgYSBub3JtYWwgcGVybXV0YXRpb24gdGVzdDsgdGhlIGxhdHRlciBydW5zIGEgcGVybXV0YXRpb24gdGVzdCBvbiBhIGdyaWQgZGVmaW5lZCBieSB0aGUgY29ycmVsYXRpb24gbWF0cml4IGFuZCBjb3JyZWN0cyBmb3IgcG9zc2libGUgY29sbGluZWFyaXR5LiBUaGlzIGlzIHNpbWlsYXIgdG8gYSByZWdyZXNzaW9uIGFuYWx5c2lzLCBidXQgbG9va3MgYXQgYm90aCBtYWluIGVmZmVjdHMgYW5kIGludGVyYWN0aW9ucy4gDQoNCllvdSBjb3VsZCB1c2UgdGhlIG5vcm1hbCBgdmFyaW1wYCBhcyBpbXBsZW1lbnRlZCBpbiBgcGFydHlgLiBUaGlzIHVzZXMgbWVhbiBkZWNyZWFzZSBpbiBhY2N1cmFjeSBzY29yZXMuIFdlIHdpbGwgdXNlIHZhcmlhYmxlIGltcG9ydGFuY2Ugc2NvcmVzIHZpYSBhbiBBVUMgYmFzZWQgcGVybXV0YXRpb24gdGVzdHMgYXMgdGhpcyB1c2VzIGJvdGggYWNjdXJhY3kgYW5kIGVycm9ycyBpbiB0aGUgbW9kZWwsIHVzaW5nIGB2YXJJbXBBVUNgIGZyb20gdGhlIGB2YXJJbXBgIHBhY2thZ2UuDQoNCioqREFOR0VSIFpPTkUqKjogdXNpbmcgY29uZGl0aW9uYWwgcGVybXV0YXRpb24gdGVzdCByZXF1aXJlcyBhIGxvdCBvZiBSQU1zLCB1bmxlc3MgeW91IGhhdmUgYWNjZXNzIHRvIGEgY2x1c3RlciwgYW5kL29yIGEgbG90IG9mIFJBTXMsIGRvIG5vdCBhdHRlbXB0IHJ1bm5pbmcgaXQuIFdlIHdpbGwgcnVuIHRoZSBub24tY29uZGl0aW9uYWwgdmVyc2lvbiBoZXJlIGZvciBkZW1vbnN0cmF0aW9uLg0KDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KVmFySW1wLmNmb3Jlc3QgPC0gdmFySW1wOjp2YXJJbXBBVUMobWRsLmNmb3Jlc3QsIGNvbmRpdGlvbmFsID0gRkFMU0UpDQpsYXR0aWNlOjpiYXJjaGFydChzb3J0KFZhckltcC5jZm9yZXN0KSkNCmBgYA0KDQoNClRoZSBWYXJpYWJsZSBJbXBvcnRhbmNlIFNjb3JlcyB2aWEgbm9uLWNvbmRpdGlvbmFsIHBlcm11dGF0aW9uIHRlc3RzIHNob3dlZCB0aGF0IGBBMiotQTMqYCAoaS5lLiwgZW5lcmd5IGluIG1pZC1oaWdoIGZyZXF1ZW5jaWVzIGFyb3VuZCBGMiBhbmQgRjMpIGlzIHRoZSBtb3N0IGltcG9ydGFudCB2YXJpYWJsZSBhdCBleHBsYWluaW5nIHRoZSBkaWZmZXJlbmNlIGJldHdlZW4gZ3V0dHVyYWxzIGFuZCBub24tZ3V0dHVyYWxzLCBmb2xsb3dlZCBieSBgWjQtWjNgIChwaGFyeW5nZWFsIGNvbnN0cmljdGlvbiksIGBIMSotQTMqYCAoZW5lcmd5IGluIG1pZC1oaWdoIGZyZXF1ZW5jeSBjb21wb25lbnQpLCBgWjItWjFgIChkZWdyZWUgb2YgY29tcGFjdG5lc3MpLCBgWjMtWjJgIChzcGVjdHJhbCBkaXZlcmdlbmNlKSwgYEgxKi1BMmAgKGVuZXJneSBpbiBtaWQgZnJlcXVlbmN5IGNvbXBvbmVudCkgYW5kIGBaMS1aMGAgKGRlZ3JlZSBvZiBvcGVubmVzcykuIEFsbCBvdGhlciBwcmVkaWN0b3JzIGNvbnRyaWJ1dGUgdG8gdGhlIGNvbnRyYXN0IGJ1dCB0byB2YXJ5aW5nIGRlZ3JlZXMgKGZyb20gYEgxKi1IMipgIHRvIGBIMSotQTEqYCkuIFRoZSBsYXN0IDUgcHJlZGljdG9ycyBhcmUgdGhlIGxlYXN0IGltcG9ydGFudCBhbmQgYW5kIHRoZSBDUFAgaGFzIGEgMCBtZWFuIGRlY3JlYXNlIGluIGFjY3VyYWN5IGFuZCBjYW4gZXZlbiBiZSBpZ25vcmVkLiANCg0KDQojIyMgQ29uY2x1c2lvbg0KDQpUaGUgYHBhcnR5YCBwYWNrYWdlIGlzIHBvd2VyZnVsIGF0IGdyb3dpbmcgUmFuZG9tIEZvcmVzdHMgdmlhIGNvbmRpdGlvbmFsIEluZmVyZW5jZSB0cmVlcywgYnV0IGlzIGNvbXB1dGF0aW9uYWxseSBwcm9oaWJpdGl2ZSB3aGVuIGluY3JlYXNpbmcgbnVtYmVyIG9mIHRyZWVzIGFuZCB1c2luZyBjb25kaXRpb25hbCBwZXJtdXRhdGlvbiB0ZXN0cyBvZiB2YXJpYWJsZSBpbXBvcnRhbmNlIHNjb3Jlcy4gV2UgbG9vayBuZXh0IGF0IHRoZSBwYWNrYWdlIGByYW5nZXJgIGR1ZSB0byBpdHMgc3BlZWQgaW4gY29tcHV0YXRpb24gYW5kIGZsZXhpYmlsaXR5LiANCg0KIyMgUmFuZ2VyDQoNClRoZSBgcmFuZ2VyYCBwYWNrYWdlIHByb3Bvc2VzIGEgcmVpbXBsZW1lbnRhdGlvbiBvZiB0aGUgb3JpZ2luYWwgUmFuZG9tIEZvcmVzdHMgYWxnb3JpdGhtcywgd3JpdHRlbiBpbiBDKysgYW5kIGFsbG93cyBmb3IgcGFyYWxsZWwgY29tcHV0aW5nLiBJdCBvZmZlcnMgbW9yZSBmbGV4aWJpbGl0eSBpbiB0ZXJtcyBvZiBtb2RlbCBzcGVjaWZpY2F0aW9uLiANCg0KIyMjIE1vZGVsIHNwZWNpZmljYXRpb24NCg0KSW4gdGhlIG1vZGVsIGJlbG93IHNwZWNpZmljYXRpb24gYmVsb3csIHRoZXJlIGFyZSBhbHJlYWR5IGEgZmV3IG9wdGlvbnMgd2UgYXJlIGZhbWlsaWFyIHdpdGgsIHdpdGggYWRkaXRpb25hbCBvbmVzIGRlc2NyaWJlZCBiZWxvdzoNCg0KMS4gYG51bS50cmVlYCA9IE51bWJlciBvZiB0cmVlcyB0byBncm93LiBXZSB1c2UgdGhlIGRlZmF1bHQgdmFsdWUNCjIuIGBtdHJ5YCA9IE51bWJlciBvZiBwcmVkaWN0b3JzIHRvIHVzZS4gRGVmYXVsdCA9IGBmbG9vcihzcXJ0KFZhcmlhYmxlcykpYC4gRm9yIGNvbXBhdGliaWxpdHkgd2l0aCBgcGFydHlgLCB3ZSB1c2UgYHJvdW5kKHNxcnQoMjMpKWANCjMuIGByZXBsYWNlID0gRkFMU0VgID0gVXNlIHN1YnNhbXBsaW5nIHdpdGggb3Igd2l0aG91dCByZXBsYWNlbWVudC4gRGVmYXVsdCBgcmVwbGFjZSA9IFRSVUVgLCBpLmUuLCBpcyAqKndpdGgqKiByZXBsYWNlbWVudC4gDQo0LiBgc2FtcGxlLmZyYWN0aW9uID0gMC42MzJgID0gVXNlIDYzLjIlIG9mIHRoZSBkYXRhIGluIGVhY2ggc3BsaXQuIERlZmF1bHQgaXMgZnVsbCBkYXRhc2V0LCBpLmUuLCBgc2FtcGxlLmZyYWN0aW9uID0gMWANCjUuIGBpbXBvcnRhbmNlID0gInBlcm11dGF0aW9uImAgPSBDb21wdXRlIHZhcmlhYmxlIGltcG9ydGFuY2Ugc2NvcmVzIHZpYSBwZXJtdXRhdGlvbiB0ZXN0cw0KNi4gYHNjYWxlLnBlcm11dGF0aW9uLmltcG9ydGFuY2UgPSBGQUxTRWAgPSB3aGV0aGVyIHRvIHNjYWxlIHZhcmlhYmxlIGltcG9ydGFuY2Ugc2NvcmVzIHRvIGJlIG91dCBvZiAxMDAlLiBEZWZhdWx0IGlzIFRSVUUuIFRoaXMgaXMgbGlrZWx5IHRvIGludHJvZHVjZSBiaWFzZXMgaW4gdmFyaWFibGUgaW1wb3J0YW5jZSBlc3RpbWF0aW9uLiANCjcuIGBzcGxpdHJ1bGUgPSAiZXh0cmF0cmVlcyJgID0gcnVsZSB1c2VkIGZvciBzcGxpdHRpbmcgdHJlZXMuIA0KOC4gYG51bS50aHJlYWRzYCA9IGFsbG93IGZvciBwYXJhbGxlbCBjb21wdXRpbmcuIEhlcmUgd2Ugb25seSBzcGVjaWZ5IDEgdGhyZWFkLCBidXQgY2FuIHVzZSBhbGwgdGhyZWFkIG9uIHlvdXIgY29tcHV0ZXIgKG9yIGNsdXN0ZXIpLg0KDQoNCldlIHVzZSBvcHRpb25zIDItNyB0byBtYWtlIHN1cmUgd2UgaGF2ZSBhbiB1bmJpYXNlZCBzZWxlY3Rpb24gcHJvY2VzcyB3aXRoIGByYW5nZXJgLiBZb3UgY2FuIHRyeSBvbiB5b3VyIG93biBydW5uaW5nIHRoZSBtb2RlbCBiZWxvdyBieSB1c2luZyB0aGUgZGVmYXVsdHMgdG8gc2VlIGhvdyB0aGUgcmF0ZSBvZiBjbGFzc2lmaWNhdGlvbiBpbmNyZWFzZXMgbW9yZSwgYnV0IHdpdGggdGhlIGNhdmVhdCB0aGF0IGl0IGhhcyBhIGJpYXNlZCBzZWxlY3Rpb24gcHJvY2Vzcy4gDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KbWRsLnJhbmdlciA8LSBkZlBoYXJWMiAlPiUgDQogIHJhbmdlcihjb250ZXh0IH4gLiwgZGF0YSA9IC4sIG51bS50cmVlcyA9IDUwMCwgbXRyeSA9IHJvdW5kKHNxcnQoMjMpKSwNCiAgICAgICAgIHJlcGxhY2UgPSBGQUxTRSwgc2FtcGxlLmZyYWN0aW9uID0gMC42MzIsIA0KICAgICAgICAgaW1wb3J0YW5jZSA9ICJwZXJtdXRhdGlvbiIsIHNjYWxlLnBlcm11dGF0aW9uLmltcG9ydGFuY2UgPSBGQUxTRSwNCiAgICAgICAgIHNwbGl0cnVsZSA9ICJleHRyYXRyZWVzIiwgbnVtLnRocmVhZHMgPSAxKQ0KbWRsLnJhbmdlcg0KYGBgDQoNCg0KUmVzdWx0cyBvZiBvdXIgUmFuZG9tIEZvcmVzdCBzaG93cyBhbiBPT0IgKE91dC1PZi1CYWcpIGVycm9yIHJhdGUgb2YgOC4yJSwgaS5lLiwgYW4gYWNjdXJhY3kgb2YgOTEuOCUuDQoNCiMjIyBHb2luZyBmdXJ0aGVyDQoNClVuZm9ydHVuYXRlbHksIHdoZW4gZ3Jvd2luZyBhIHRyZWUgd2l0aCBgcmFuZ2VyYCwgd2UgY2Fubm90IHVzZSBwcmVkaWN0aW9ucyBmcm9tIHRoZSBPT0Igc2FtcGxlIGFzIHRoZXJlIGlzIG5vIGNvbXBhcmFibGUgb3B0aW9ucyB0byBkbyBzbyBvbiB0aGUgcHJlZGljdGlvbnMuIFdlIG5lZWQgdG8gaGFyZC1jb2RlIHRoaXMuIFdlIHNwbGl0IHRoZSBkYXRhIGludG8gYSB0cmFpbmluZyBhbmQgYSB0ZXN0aW5nIHNldHMuIFRoZSB0cmFpbmluZyB3aWxsIGJlIG9uIDIvM3Mgb2YgdGhlIGRhdGE7IHRoZSB0ZXN0aW5nIGlzIG9uIHRoZSByZW1haW5pbmcgMS8zLiANCg0KIyMjIyBDcmVhdGUgYSB0cmFpbmluZyBhbmQgYSB0ZXN0aW5nIHNldA0KDQpgYGB7cn0NCnNldC5zZWVkKDEyMzQ1NikNCnRyYWluLmlkeCA8LSBzYW1wbGUobnJvdyhkZlBoYXJWMiksIDIvMyAqIG5yb3coZGZQaGFyVjIpKQ0KZ3V0dC50cmFpbiA8LSBkZlBoYXJWMlt0cmFpbi5pZHgsIF0NCmd1dHQudGVzdCA8LSBkZlBoYXJWMlstdHJhaW4uaWR4LCBdDQpgYGANCg0KDQojIyMjIE1vZGVsIHNwZWNpZmljYXRpb24NCg0KV2UgdXNlIHRoZSBzYW1lIG1vZGVsIHNwZWNpZmljYXRpb24gYXMgYWJvdmUsIGV4Y2VwdCBmcm9tIHVzaW5nIHRoZSB0cmFpbmluZyBzZXQgYW5kIHNhdmluZyB0aGUgZm9yZXN0ICh3aXRoIGB3cml0ZS5mb3Jlc3QgPSBUUlVFYCkuDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KbWRsLnJhbmdlcjIgPC0gZ3V0dC50cmFpbiAlPiUgDQogIHJhbmdlcihjb250ZXh0IH4gLiwgZGF0YSA9IC4sIG51bS50cmVlcyA9IDUwMCwgbXRyeSA9IHJvdW5kKHNxcnQoMjMpKSwNCiAgICAgICAgIHJlcGxhY2UgPSBGQUxTRSwgc2FtcGxlLmZyYWN0aW9uID0gMC42MzIsIA0KICAgICAgICAgaW1wb3J0YW5jZSA9ICJwZXJtdXRhdGlvbiIsIHNjYWxlLnBlcm11dGF0aW9uLmltcG9ydGFuY2UgPSBGQUxTRSwNCiAgICAgICAgIHNwbGl0cnVsZSA9ICJleHRyYXRyZWVzIiwgbnVtLnRocmVhZHMgPSAxLCB3cml0ZS5mb3Jlc3QgPSBUUlVFKQ0KbWRsLnJhbmdlcjINCmBgYA0KDQpXaXRoIHRoZSB0cmFpbmluZyBzZXQsIHdlIGhhdmUgYW4gT09CIGVycm9yIHJhdGUgb2YgOS4zJTsgaS5lLiwgYW4gYWNjdXJhY3kgcmF0ZSBvZiA5MC43JS4NCg0KIyMjIyBQcmVkaWN0aW9ucw0KIA0KRm9yIHRoZSBwcmVkaWN0aW9ucywgd2UgdXNlIHRoZSB0ZXN0aW5nIHNldCBhcyBhIHZhbGlkYXRpb24gc2V0LiBUaGlzIGlzIHRvIGJlIGNvbnNpZGVyZWQgYXMgYSB0cnVlIHJlZmxlY3Rpb24gb2YgdGhlIG1vZGVsLiBUaGlzIGlzIHVuc2VlbiBkYXRhIG5vdCB1c2VkIGluIHRoZSB0cmFpbmluZyBzZXQuDQoNCg0KYGBge3J9DQpzZXQuc2VlZCgxMjM0NTYpDQpwcmVkLnJhbmdlcjIgPC0gcHJlZGljdChtZGwucmFuZ2VyMiwgZGF0YSA9IGd1dHQudGVzdCkNCnRibC5yYW5nZXIyIDwtIHRhYmxlKHByZWQucmFuZ2VyMiRwcmVkaWN0aW9ucywgZ3V0dC50ZXN0JGNvbnRleHQpDQp0YmwucmFuZ2VyMg0KUHJlc2VuY2VBYnNlbmNlOjpwY2ModGJsLnJhbmdlcjIpDQpQcmVzZW5jZUFic2VuY2U6OnNwZWNpZmljaXR5KHRibC5yYW5nZXIyKQ0KUHJlc2VuY2VBYnNlbmNlOjpzZW5zaXRpdml0eSh0YmwucmFuZ2VyMikNCg0Kcm9jLnJhbmdlciA8LSBwUk9DOjpyb2MoZ3V0dC50ZXN0JGNvbnRleHQsIGFzLm51bWVyaWMocHJlZC5yYW5nZXIyJHByZWRpY3Rpb25zKSkNCnJvYy5yYW5nZXINCnBST0M6OnBsb3Qucm9jKHJvYy5yYW5nZXIsIGxlZ2FjeS5heGVzID0gVFJVRSkNCmBgYA0KDQoNClRoZSBjbGFzc2lmaWNhdGlvbiByYXRlIGJhc2VkIG9uIHRoZSB0ZXN0aW5nIHNldCBpcyA4Ni42JS4gVGhpcyBpcyBjb21wYXJhYmxlIHRvIHRoZSBvbmUgd2Ugb2J0YWluZWQgd2l0aCBgY2ZvcmVzdGAuIFRoZSBjaGFuZ2VzIGluIHRoZSBzZXR0aW5ncyBhbGxvdyBmb3Igc2ltaWxhcml0aWVzIGluIHRoZSBwcmVkaWN0aW9ucyBvYnRhaW5lZCBmcm9tIGJvdGggYHBhcnR5YCBhbmQgYHJhbmdlcmAuIA0KDQojIyMjIFZhcmlhYmxlIEltcG9ydGFuY2UgU2NvcmVzDQoNCiMjIyMjIERlZmF1bHQNCg0KRm9yIHRoZSB2YXJpYWJsZSBpbXBvcnRhbmNlIHNjb3Jlcywgd2Ugb2J0YWluIHRoZW0gZnJvbSBlaXRoZXIgdGhlIHRyYWluaW5nIHNldCBvciB0aGUgZnVsbCBtb2RlbCBhYm92ZS4NCg0KDQpgYGB7cn0NCnNldC5zZWVkKDEyMzQ1NikNCmxhdHRpY2U6OmJhcmNoYXJ0KHNvcnQobWRsLnJhbmdlcjIkdmFyaWFibGUuaW1wb3J0YW5jZSksIG1haW4gPSAiVmFyaWFibGUgSW1wb3J0YW5jZSBzY29yZXMgLSB0cmFpbmluZyBzZXQiKQ0KbGF0dGljZTo6YmFyY2hhcnQoc29ydChtZGwucmFuZ2VyJHZhcmlhYmxlLmltcG9ydGFuY2UpLCBtYWluID0gIlZhcmlhYmxlIEltcG9ydGFuY2Ugc2NvcmVzIC0gZnVsbCBzZXQiKQ0KYGBgDQoNCg0KVGhlcmUgYXJlIHNpbWlsYXJpdGllcyBiZXR3ZWVuIGBjZm9yZXN0YCBhbmQgYHJhbmdlcmAsIHdpdGggbWlub3IgZGlmZmVyZW5jZXMuIGBaMi1aMWAgaXMgdGhlIGJlc3QgcHJlZGljdG9yIGF0IGV4cGxhaW5pbmcgdGhlIGRpZmZlcmVuY2VzIGJldHdlZW4gZ3V0dHVyYWxzIGFuZCBub24tZ3V0dHVyYWxzIHdpdGggYHJhbmdlcmAgZm9sbG93ZWQgYnkgYFozLVoyYCBhbmQgdGhlbiBgQTIqLUEzKmAsIChyZXZlcnNlIHdpdGggYGNmb3Jlc3RgISkuIFRoZSBvcmRlciBvZiB0aGUgYWRkaXRpb25hbCBwcmVkaWN0b3JzIGlzIHNpZ2h0bHkgZGlmZmVyZW50IGJldHdlZW4gdGhlIHR3byBtb2RlbHMuIFRoaXMgaXMgZXhwZWN0ZWQgYXMgdGhlIGBjZm9yZXN0YCBtb2RlbCBvbmx5IHVzZWQgMTAwIHRyZWVzLCB3aGVyZWFzIHRoZSBgcmFuZ2VyYCBtb2RlbCB1c2VkIDUwMCB0cmVlcy4NCg0KDQpBIGNsZWFyIGRpZmZlcmVuY2UgYmV0d2VlbiB0aGUgcGFja2FnZXMgYHBhcnR5YCBhbmQgYHJhbmdlcmAgaXMgdGhhdCB0aGUgZm9ybWVyIGFsbG93cyBmb3IgY29uZGl0aW9uYWwgcGVybXV0YXRpb24gdGVzdHMgZm9yIHZhcmlhYmxlIGltcG9ydGFuY2Ugc2NvcmVzOyB0aGlzIGlzIGFic2VudCBmcm9tIGByYW5nZXJgLiBIb3dldmVyLCB0aGVyZSBpcyBhIGRlYmF0ZSBpbiB0aGUgbGl0ZXJhdHVyZSBvbiB3aGV0aGVyIGNvcnJlbGF0ZWQgZGF0YSBhcmUgaGFybWZ1bCB3aXRoaW4gUmFuZG9tIEZvcmVzdHMuIEl0IGlzIGNsZWFyIHRoYXQgaG93IFJhbmRvbSBGb3Jlc3RzIHdvcmssIGkuZS4sIHRoZSByYW5kb21uZXNzIGluIHRoZSBzZWxlY3Rpb24gcHJvY2VzcyBpbiBudW1iZXIgb2YgZGF0YSBwb2ludHMsIHByZWRpY3RvcnMsIHNwbGl0dGluZyBydWxlcywgZXRjLiBhbGxvdyB0aGUgdHJlZXMgdG8gYmUgZGVjb3JyZWxhdGVkIGZyb20gZWFjaCBvdGhlci4gSGVuY2UsIHRoZSBjb25kaXRpb25hbCBwZXJtdXRhdGlvbiB0ZXN0cyBtYXkgbm90IGJlIHJlcXVpcmVkLiBCdXQgd2hhdCB0aGV5IG9mZmVyIGlzIHRvIGNvbmRpdGlvbiB2YXJpYWJsZSBpbXBvcnRhbmNlIHNjb3JlcyBvbiBlYWNoIG90aGVyIChiYXNlZCBvbiBjb3JyZWxhdGlvbiB0ZXN0cykgdG8gbWltaWMgd2hhdCBhIG11bHRpcGxlIHJlZ3Jlc3Npb24gYW5hbHlzaXMgZG9lcyAoYnV0IHdpdGhvdXQgc3VmZmVyaW5nIGZyb20gc3VwcHJlc3Npb24hKS4gU3Ryb25nIHByZWRpY3RvcnMgd2lsbCBzaG93IG1ham9yIGNvbnRyaWJ1dGlvbiwgd2hpbGUgd2VhayBvbmVzIHdpbGwgYmUgc3F1YXNoZWQgZ2l2aW5nIHRoZW0gZXh0cmVtZWx5IGxvdyAob3IgZXZlbiBuZWdhdGl2ZSkgc2NvcmVzLiBXaXRoaW4gYHJhbmdlcmAsIGl0IGlzIHBvc3NpYmxlIHRvIGV2YWx1YXRlIHRoaXMgYnkgZXN0aW1hdGluZyBwIHZhbHVlcyBhc3NvY2lhdGVkIHdpdGggZWFjaCB2YXJpYWJsZSBpbXBvcnRhbmNlLldlIHVzZSB0aGUgYGFsdG1hbmAgbWV0aG9kLiBTZWUgZG9jdW1lbnRhdGlvbiBmb3IgbW9yZSBkZXRhaWxzLiANCg0KKipEQU5HRVIgWk9ORSoqOiBUaGlzIHJlcXVpcmVzIGhlYXZ5IGNvbXB1dGF0aW9ucy4gVXNlIHdpdGggYWxsIGNvcmVzIG9uIHlvdXIgbWFjaGluZSBvciBpbiB0aGUgY2x1c3Rlci4gUmVjb21tZW5kYXRpb25zIGFyZSB0byB1c2UgYSBtaW5pbXVtIG9mIDEwMCBwZXJtdXRhdGlvbnMgb3IgbW9yZSwgaS5lLiwgYG51bS5wZXJtdXRhdGlvbnMgPSAxMDBgLiBIZXJlLCB3ZSBvbmx5IHVzZSAyMCB0byBzaG93IHRoZSBvdXRwdXQuDQoNCiMjIyMjIFdpdGggcCB2YWx1ZXMNCg0KYGBge3J9DQpzZXQuc2VlZCgxMjM0NTYpDQpWYXJJbXAucHZhbCA8LSBpbXBvcnRhbmNlX3B2YWx1ZXMobWRsLnJhbmdlcjIsIG1ldGhvZCA9ICJhbHRtYW5uIiwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBudW0ucGVybXV0YXRpb25zID0gMjAsIA0KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZvcm11bGEgPSBjb250ZXh0IH4gLiwgZGF0YSA9IGd1dHQudHJhaW4sDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbnVtLnRocmVhZHMgPSAyKQ0KVmFySW1wLnB2YWwNCmBgYA0KDQoNCk9mIGNvdXJzZSwgdGhlIG91dHB1dCBhYm92ZSBzaG93cyB2YXJpYWJsZSBwIHZhbHVlcy4gVGhlIGxvd2VzdCBpcyBhdCAwLjA0OCBmb3IgYWxsIHByZWRpY3RvcnM7IG9uZSBhdCAwLjE0IGZvciBDUFAuIFJlY2FsbCB0aGF0IENQUCByZWNlaXZlZCB0aGUgbG93ZXN0IHZhcmlhYmxlIGltcG9ydGFuY2Ugc2NvcmUgd2l0aGluIGByYW5nZXJgIGFuZCBgY2ZvcmVzdGAuIElmIHlvdSBpbmNyZWFzZSBwZXJtdXRhdGlvbnMgdG8gMTAwIG9yIDIwMCwgeW91IHdpbGwgZ2V0IG1vcmUgY29uZmlkZW5jZSBpbiB5b3VyIHJlc3VsdHMgYW5kIGNhbiByZXBvcnQgdGhlIHAgdmFsdWVzDQoNCg0KDQojIyBVcCB0byB5b3UhDQoNCkZvbGxvd2luZyB3aGF0IHdlIGhhdmUgZG9uZSBhYm92ZSB3aXRoIGRlY2lzaW9uIHRyZWVzLCBydW4gYSBSYW5kb20gRm9yZXN0IGVpdGhlciB3aXRoIGBwYXJ0eWAgb3IgYHJhbmdlcmAgb24gZm9ybWFudHMgb3Igdm9pY2UgcXVhbGl0eS4gRGlzY3VzcyB3aXRoIHlvdXIgcGVlcnMgdGhlIHJlc3VsdHMgYW5kIHdlIGNhbiBkaXNjdXNzIGFueSBpc3N1ZXMuLiBZb3UgbmVlZCB0byAxKSBzZWxlY3QgdmFyaWFibGVzIGFuZCAyKSBydW4gdGhlIGNvZGUuIERvbid0IGZvcmdldCwgeW91IGNhbiBzaW1wbHkgY29weSBhbmQgcGFzdGUgdGhlIGNvZGUsIGJ1dCBpdCBpcyBiZXN0IHRvIHRyeSB0byByZWNhbGwgdGhlIGNhbGwgZnVuY3Rpb25zLiANCg0KDQpBbnN3ZXIgYmVsb3chIQ0KDQpgYGB7cn0NCiMgZm9ybWFudHMNCmBgYA0KDQoNCg0KDQoNCmBgYHtyfQ0KIyBWb2ljZSBxdWFsaXR5DQpgYGANCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KDQoNCg0KYGBge3J9DQpzZXQuc2VlZCgxMjM0NTYpDQojIFdpdGggYHBhcnR5YA0KIyMgZm9ybWFudHMNCm1kbC5jZm9yZXN0LkZvcm0gPC0gZGZGb3JtICU+JSANCiAgY2ZvcmVzdChjb250ZXh0IH4gLiwgZGF0YSA9IC4sIA0KICAgICAgICAgIGNvbnRyb2xzID0gY2ZvcmVzdF91bmJpYXNlZChudHJlZSA9IDEwMCwgDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG10cnkgPSByb3VuZChzcXJ0KDQpKSkpDQpwcmVkLmNmb3Jlc3QuRm9ybSA8LSBwcmVkaWN0KG1kbC5jZm9yZXN0LkZvcm0sIE9PQiA9IFRSVUUpDQp0YmwuY2ZvcmVzdC5Gb3JtIDwtIHRhYmxlKHByZWQuY2ZvcmVzdC5Gb3JtLCBkZkZvcm0kY29udGV4dCkNCnRibC5jZm9yZXN0LkZvcm0NClByZXNlbmNlQWJzZW5jZTo6cGNjKHRibC5jZm9yZXN0LkZvcm0pDQpQcmVzZW5jZUFic2VuY2U6OnNwZWNpZmljaXR5KHRibC5jZm9yZXN0LkZvcm0pDQpQcmVzZW5jZUFic2VuY2U6OnNlbnNpdGl2aXR5KHRibC5jZm9yZXN0LkZvcm0pDQpyb2MuY2ZvcmVzdC5Gb3JtIDwtIHBST0M6OnJvYyhkZkZvcm0kY29udGV4dCwgYXMubnVtZXJpYyhwcmVkLmNmb3Jlc3QuRm9ybSkpDQpyb2MuY2ZvcmVzdC5Gb3JtDQpwUk9DOjpwbG90LnJvYyhyb2MuY2ZvcmVzdC5Gb3JtLCBsZWdhY3kuYXhlcyA9IFRSVUUpDQoNCnNldC5zZWVkKDEyMzQ1NikNCiMjIFZRDQptZGwuY2ZvcmVzdC5WUSA8LSBkZlZRICU+JSANCiAgY2ZvcmVzdChjb250ZXh0IH4gLiwgZGF0YSA9IC4sIA0KICAgICAgICAgIGNvbnRyb2xzID0gY2ZvcmVzdF91bmJpYXNlZChudHJlZSA9IDEwMCwgDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG10cnkgPSByb3VuZChzcXJ0KDE5KSkpKQ0KcHJlZC5jZm9yZXN0LlZRIDwtIHByZWRpY3QobWRsLmNmb3Jlc3QuVlEsIE9PQiA9IFRSVUUpDQp0YmwuY2ZvcmVzdC5WUSA8LSB0YWJsZShwcmVkLmNmb3Jlc3QuVlEsIGRmVlEkY29udGV4dCkNCnRibC5jZm9yZXN0LlZRDQpQcmVzZW5jZUFic2VuY2U6OnBjYyh0YmwuY2ZvcmVzdC5WUSkNClByZXNlbmNlQWJzZW5jZTo6c3BlY2lmaWNpdHkodGJsLmNmb3Jlc3QuVlEpDQpQcmVzZW5jZUFic2VuY2U6OnNlbnNpdGl2aXR5KHRibC5jZm9yZXN0LlZRKQ0Kcm9jLmNmb3Jlc3QuVlEgPC0gcFJPQzo6cm9jKGRmVlEkY29udGV4dCwgYXMubnVtZXJpYyhwcmVkLmNmb3Jlc3QuVlEpKQ0Kcm9jLmNmb3Jlc3QuVlENCnBST0M6OnBsb3Qucm9jKHJvYy5jZm9yZXN0LlZRLCBsZWdhY3kuYXhlcyA9IFRSVUUpDQoNCmBgYA0KDQoNCg0KDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KIyBXaXRoIGByYW5nZXJgDQojIyBmb3JtYW50cw0KIyMjIHRyYWluaW5nIHNldA0KdHJhaW4uaWR4IDwtIHNhbXBsZShucm93KGRmRm9ybSksIDIvMyAqIG5yb3coZGZGb3JtKSkNCmd1dHQudHJhaW4gPC0gZGZGb3JtW3RyYWluLmlkeCwgXQ0KZ3V0dC50ZXN0IDwtIGRmRm9ybVstdHJhaW4uaWR4LCBdDQojIyMgbW9kZWwNCm1kbC5yYW5nZXIuRm9ybSA8LSBndXR0LnRyYWluICU+JSANCiAgcmFuZ2VyKGNvbnRleHQgfiAuLCBkYXRhID0gLiwgbnVtLnRyZWVzID0gNTAwLCBtdHJ5ID0gcm91bmQoc3FydCg0KSksDQogICAgICAgICByZXBsYWNlID0gRkFMU0UsIHNhbXBsZS5mcmFjdGlvbiA9IDAuNjMyLCANCiAgICAgICAgIGltcG9ydGFuY2UgPSAicGVybXV0YXRpb24iLCBzY2FsZS5wZXJtdXRhdGlvbi5pbXBvcnRhbmNlID0gRkFMU0UsDQogICAgICAgICBzcGxpdHJ1bGUgPSAiZXh0cmF0cmVlcyIsIG51bS50aHJlYWRzID0gMSwgd3JpdGUuZm9yZXN0ID0gVFJVRSkNCg0KIyMjIHByZWRpY3Rpb25zDQpwcmVkLnJhbmdlci5Gb3JtIDwtIHByZWRpY3QobWRsLnJhbmdlci5Gb3JtLCBkYXRhID0gZ3V0dC50ZXN0KQ0KdGJsLnJhbmdlci5Gb3JtIDwtIHRhYmxlKHByZWQucmFuZ2VyLkZvcm0kcHJlZGljdGlvbnMsIGd1dHQudGVzdCRjb250ZXh0KQ0KdGJsLnJhbmdlci5Gb3JtDQpQcmVzZW5jZUFic2VuY2U6OnBjYyh0YmwucmFuZ2VyLkZvcm0pDQpQcmVzZW5jZUFic2VuY2U6OnNwZWNpZmljaXR5KHRibC5yYW5nZXIuRm9ybSkNClByZXNlbmNlQWJzZW5jZTo6c2Vuc2l0aXZpdHkodGJsLnJhbmdlci5Gb3JtKQ0Kcm9jLnJhbmdlci5Gb3JtIDwtIHBST0M6OnJvYyhndXR0LnRlc3QkY29udGV4dCwgYXMubnVtZXJpYyhwcmVkLnJhbmdlci5Gb3JtJHByZWRpY3Rpb25zKSkNCnJvYy5yYW5nZXIuRm9ybQ0KcFJPQzo6cGxvdC5yb2Mocm9jLnJhbmdlci5Gb3JtLCBsZWdhY3kuYXhlcyA9IFRSVUUpDQoNCnNldC5zZWVkKDEyMzQ1NikNCiMjIFZRDQojIyB0cmFpbmluZyBzZXRzDQp0cmFpbi5pZHggPC0gc2FtcGxlKG5yb3coZGZWUSksIDIvMyAqIG5yb3coZGZWUSkpDQpndXR0LnRyYWluIDwtIGRmVlFbdHJhaW4uaWR4LCBdDQpndXR0LnRlc3QgPC0gZGZWUVstdHJhaW4uaWR4LCBdDQojIyBtb2RlbA0KbWRsLnJhbmdlci5WUSA8LSBndXR0LnRyYWluICU+JSANCiAgcmFuZ2VyKGNvbnRleHQgfiAuLCBkYXRhID0gLiwgbnVtLnRyZWVzID0gNTAwLCBtdHJ5ID0gcm91bmQoc3FydCgxOSkpLA0KICAgICAgICAgcmVwbGFjZSA9IEZBTFNFLCBzYW1wbGUuZnJhY3Rpb24gPSAwLjYzMiwgDQogICAgICAgICBpbXBvcnRhbmNlID0gInBlcm11dGF0aW9uIiwgc2NhbGUucGVybXV0YXRpb24uaW1wb3J0YW5jZSA9IEZBTFNFLA0KICAgICAgICAgc3BsaXRydWxlID0gImV4dHJhdHJlZXMiLCBudW0udGhyZWFkcyA9IDEsIHdyaXRlLmZvcmVzdCA9IFRSVUUpDQoNCiMjIHByZWRpY3Rpb25zDQpwcmVkLnJhbmdlci5WUSA8LSBwcmVkaWN0KG1kbC5yYW5nZXIuVlEsIGRhdGEgPSBndXR0LnRlc3QpDQp0YmwucmFuZ2VyLlZRIDwtIHRhYmxlKHByZWQucmFuZ2VyLlZRJHByZWRpY3Rpb25zLCBndXR0LnRlc3QkY29udGV4dCkNCnRibC5yYW5nZXIuVlENClByZXNlbmNlQWJzZW5jZTo6cGNjKHRibC5yYW5nZXIuVlEpDQpQcmVzZW5jZUFic2VuY2U6OnNwZWNpZmljaXR5KHRibC5yYW5nZXIuVlEpDQpQcmVzZW5jZUFic2VuY2U6OnNlbnNpdGl2aXR5KHRibC5yYW5nZXIuVlEpDQpyb2MucmFuZ2VyLlZRIDwtIHBST0M6OnJvYyhndXR0LnRlc3QkY29udGV4dCwgYXMubnVtZXJpYyhwcmVkLnJhbmdlci5WUSRwcmVkaWN0aW9ucykpDQpyb2MucmFuZ2VyLlZRDQpwUk9DOjpwbG90LnJvYyhyb2MucmFuZ2VyLlZRLCBsZWdhY3kuYXhlcyA9IFRSVUUpDQoNCmBgYA0KDQoNCg0KSW4gdGhlIG5leHQgcGFydCwgd2UgbG9vayBhdCB0aGUgYHRpZHltb2RlbHNgIGFuZCBpbnRyb2R1Y2UgdGhlaXIgcGhpbG9zb3BoeS4gDQoNCiMgUmFuZG9tIGZvcmVzdHMgd2l0aCBUaWR5bW9kZWxzDQoNClRoZSBgdGlkeW1vZGVsc2AgYXJlIGEgYnVuZGxlIG9mIHBhY2thZ2VzIHVzZWQgdG8gc3RyZWFtbGluZSBhbmQgc2ltcGxpZnkgdGhlIHVzZSBvZiBtYWNoaW5lIGxlYXJuaW5nLiBUaGUgYHRpZHltb2RlbHNgIGFyZSBub3QgcmVzdHJpY3RlZCB0byBSYW5kb20gRm9yZXN0cywgYW5kIHlvdSBjYW4gZXZlbiB1c2UgdGhlbSB0byBydW4gc2ltcGxlIGxpbmVhciBtb2RlbHMsIGxvZ2lzdGljIHJlZ3Jlc3Npb25zLCBQQ0EsIFJhbmRvbSBGb3Jlc3RzLCBEZWVwIExlYXJuaW5nLCBldGMuDQoNClRoZSBgdGlkeW1vZGVsc2AnIHBoaWxvc29waHkgaXMgdG8gc2VwYXJhdGUgZGF0YSBwcm9jZXNzaW5nIG9uIHRoZSB0cmFpbmluZyBhbmQgdGVzdGluZyBzZXRzLCBhbmQgdXNlIG9mIGEgd29ya2Zsb3cuIEJlbG93LCBpcyBhbiBmdWxsIGV4YW1wbGUgb2YgaG93IG9uZSBjYW4gcnVuIFJhbmRvbSBGb3Jlc3RzIHdpdGggdmlhIGByYW5nZXJgIHVzaW5nIHRoZSBgdGlkeW1vZGVsc2AuDQoNCiMjIFRyYWluaW5nIGFuZCB0ZXN0aW5nIHNldHMNCg0KV2Ugc3RhcnQgYnkgY3JlYXRpbmcgYSB0cmFpbmluZyBhbmQgYSB0ZXN0aW5nIHNldCB1c2luZyB0aGUgZnVuY3Rpb24gYGluaXRpYWxfc3BsaXRgLiBVc2luZyBgc3RyYXRhID0gY29udGV4dGAgYWxsb3dzIHRoZSBtb2RlbCB0byBzcGxpdCB0aGUgZGF0YSB0YWtpbmcgaW50byBhY2NvdW50IGl0cyBzdHJ1Y3R1cmUgYW5kIHNwbGl0cyB0aGUgZGF0YSBhY2NvcmRpbmcgdG8gcHJvcG9ydGlvbnMgb2YgZWFjaCBncm91cC4gDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KdHJhaW5fdGVzdF9zcGxpdCA8LQ0KICBpbml0aWFsX3NwbGl0KA0KICAgIGRhdGEgPSBkZlBoYXJWMiwNCiAgICBzdHJhdGEgPSAiY29udGV4dCIsDQogICAgcHJvcCA9IDAuNjY3KSANCnRyYWluX3Rlc3Rfc3BsaXQNCnRyYWluX3RibCA8LSB0cmFpbl90ZXN0X3NwbGl0ICU+JSB0cmFpbmluZygpIA0KdGVzdF90YmwgIDwtIHRyYWluX3Rlc3Rfc3BsaXQgJT4lIHRlc3RpbmcoKQ0KYGBgDQoNCg0KIyMgU2V0IGZvciBjcm9zcy12YWxpZGF0aW9uDQoNCldlIGNhbiAoaWYgd2Ugd2FudCB0byksIGNyZWF0ZSBhIDEwLWZvbGRzIGNyb3NzLXZhbGlkYXRpb24gb24gdGhlIHRyYWluaW5nIHNldC4gVGhpcyBhbGxvd3MgdG8gZmluZSB0dW5lIHRoZSB0cmFpbmluZyBieSBvYnRhaW5pbmcgdGhlIGZvcmVzdCB3aXRoIHRoZSBoaWdoZXN0IGFjY3VyYWN5LiBUaGlzIGlzIGEgY2xlYXIgZGlmZmVyZW5jZSB3aXRoIGByYW5nZXJgLiBXaGlsZSBpdCBpcyBub3QgaW1wb3NzaWJsZSB0byBoYXJkIGNvZGUgdGhhdCwgYHRpZHltb2RlbHNgIHNpbXBsaWZ5IGl0IGZvciB1cyEhDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KdHJhaW5fY3YgPC0gdmZvbGRfY3YodHJhaW5fdGJsLCB2ID0gMTAsIHN0cmF0YSA9ICJjb250ZXh0IikNCmBgYA0KDQojIyBNb2RlbCBTcGVjaWZpY2F0aW9uDQoNCldpdGhpbiB0aGUgbW9kZWwgc3BlY2lmaWNhdGlvbiwgd2UgbmVlZCB0byBzcGVjaWZ5IG11bHRpcGxlIG9wdGlvbnM6DQoNCjEuIEEgYHJlY2lwZWA6IFRoaXMgaXMgdGhlIHJlY2lwZSBhbmQgaXMgcmVsYXRlZCB0byBhbnkgZGF0YSBwcm9jZXNzaW5nIG9uZSB3YW50cyB0byBhcHBseSBvbiB0aGUgZGF0YS4NCjIuIEFuIGBlbmdpbmVgOiBXZSBuZWVkIHRvIHNwZWNpZnkgdGhlIGBlbmdpbmVgIHRvIHVzZS4gSGVyZSB3ZSB3YW50IHRvIHJ1biBhIFJhbmRvbSBGb3Jlc3QuDQozLiBBIGB0dW5pbmdgOiBIZXJlIHdlIGNhbiB0dW5lIG91ciBlbmdpbmUNCjQuIEEgYHdvcmtmbG93YDogaGVyZSB3ZSBzcGVjaWZ5IHRoZSB2YXJpb3VzIHN0ZXBzIG9mIHRoZSB3b3JrZmxvdw0KDQoNCiMjIyBSZWNpcGUNCg0KV2hlbiBkZWZpbmluZyB0aGUgcmVjaXBlLCB5b3UgbmVlZCB0byB0aGluayBvZiB0aGUgdHlwZSBvZiAidHJhbnNmb3JtYXRpb25zIiB5b3Ugd2lsbCBhcHBseSB0byB5b3VyIGRhdGEuIA0KDQoxLiBaLXNjb3JpbmcgaXMgdGhlIGZpcnN0IHRoaW5nIHRoYXQgY29tZXMgdG8gbWluZC4gV2hlbiB5b3Ugei1zY29yZSB0aGUgZGF0YSwgeW91IGFyZSBhbGxvd2luZyBhbGwgc3Ryb25nIGFuZCB3ZWFrIHByZWRpY3RvcnMgdG8gYmUgY29uc2lkZXJlZCBlcXVhbGx5IGJ5IHRoZSBtb2RlbC4gVGhpcyBpcyBpbXBvcnRhbnQgYXMgc29tZSBvZiBvdXIgcHJlZGljdG9ycyBoYXZlIHZlcnkgbGFyZ2UgZGlmZmVyZW5jZXMgcmVsYXRlZCB0byB0aGUgbGV2ZWxzIG9mIGNvbnRleHQgYW5kIGhhdmUgZGlmZmVyZW50IG1lYXN1cmVtZW50IHNjYWxlcy4gV2UgY291bGQgaGF2ZSBhcHBsaWVkIGl0IGFib3ZlLCBidXQgd2UgbmVlZCB0byBtYWtlIHN1cmUgdG8gYXBwbHkgaXQgc2VwYXJhdGVseSBvbiBib3RoIHRyYWluaW5nIGFuZCB0ZXN0aW5nIHNldHMgKG90aGVyd2lzZSwgb3VyIG1vZGVsIHN1ZmZlcnMgZnJvbSBkYXRhIGxlYWthZ2UpDQoyLiBJZiB5b3UgaGF2ZSBhbnkgbWlzc2luZyBkYXRhLCB5b3UgY2FuIHVzZSBjZW50cmFsIGltcHV0YXRpb25zIHRvIGZpbGwgaW4gbWlzc2luZyBkYXRhIChyYW5kb20gZm9yZXN0cyBkbyBub3QgbGlrZSBtaXNzaW5nIGRhdGEsIHRob3VnaCB0aGV5IGNhbiB3b3JrIHdpdGggdGhlbSkuIA0KMy4gWW91IGNhbiBhcHBseSBQQ0Egb24gYWxsIHlvdXIgcHJlZGljdG9ycyB0byByZW1vdmUgY29sbGluZWFyaXR5IGJlZm9yZSBydW5uaW5nIHJhbmRvbSBmb3Jlc3RzLiBUaGlzIGlzIGEgZ3JlYXQgb3B0aW9uIHRvIGNvbnNpZGVyLCBidXQgYWRkcyBtb3JlIGNvbXBsZXhpdHkgdG8geW91ciBtb2RlbC4gDQo0LkZpbmFsbHksIGlmIHlvdSBoYXZlIGNhdGVnb3JpY2FsIHByZWRpY3RvcnMsIHlvdSBjYW4gdHJhbnNmb3JtIHRoZW0gaW50byBkdW1teSB2YXJpYWJsZXMgdXNpbmcgYHN0ZXBfZHVtbXkoKWA6IDFzIGFuZCAycyBmb3IgYmluYXJ5OyBvciB1c2Ugb25lLWhvdC1lbmNvZGluZyBgc3RlcF9kdW1teShwcmVkaWN0b3IsIG9uZV9ob3QgPSBUUlVFKWANCg0KU2VlIGRvY3VtZW50YXRpb25zIG9mIGB0aWR5bW9kZWxzYCBmb3Igd2hhdCB5b3UgY2FuIGFwcGx5ISENCg0KDQpgYGB7cn0NCnNldC5zZWVkKDEyMzQ1NikNCnJlY2lwZSA8LSAgDQogIHRyYWluX3RibCAlPiUNCiAgcmVjaXBlKGNvbnRleHQgfiAuKSAlPiUNCiAgc3RlcF9jZW50ZXIoYWxsX3ByZWRpY3RvcnMoKSwgLWFsbF9vdXRjb21lcygpKSAlPiUNCiAgc3RlcF9zY2FsZShhbGxfcHJlZGljdG9ycygpLCAtYWxsX291dGNvbWVzKCkpICU+JSANCiAgcHJlcCgpDQoNCnRyYWluRGF0YV9iYWtlZCA8LSBiYWtlKHJlY2lwZSwgbmV3X2RhdGEgPSB0cmFpbl90YmwpICMgY29udmVydCB0byB0aGUgdHJhaW4gZGF0YSB0byB0aGUgbmV3bHkgaW1wdXRlZCBkYXRhDQp0cmFpbkRhdGFfYmFrZWQNCg0KYGBgDQoNCk9uY2Ugd2UgaGF2ZSBwcmVwYXJlZCB0aGUgYHJlY2lwZWAsIHdlIGNhbiBgYmFrZSBpdGAgdG8gc2VlIHRoZSBjaGFuZ2VzIGFwcGxpZWQgdG8gaXQuDQoNCiMjIyBTZXR0aW5nIHRoZSBlbmdpbmUNCg0KV2Ugc2V0IHRoZSBlbmdpbmUgaGVyZSBhcyBhIGByYW5kX2ZvcmVzdGAuIFdlIHNwZWNpZnkgYSBjbGFzc2lmaWNhdGlvbiBtb2RlLiBUaGVuLCB3ZSBzZXQgYW4gZW5naW5lIHdpdGggZW5naW5lIHNwZWNpZmljIHBhcmFtZXRlcnMuIA0KDQpgYGB7cn0NCnNldC5zZWVkKDEyMzQ1NikNCmVuZ2luZV90aWR5bSA8LSByYW5kX2ZvcmVzdCgNCiAgICBtb2RlID0gImNsYXNzaWZpY2F0aW9uIiwNCiAgICAjIyB0byB0dW5lIGJvdGggbXRyeSBhbmQgdHJlZXMsIHVuY29tbWVudCB0aGUgdHdvIGxpbmVzIGJlbG93IGFuZCBjb21tZW50IHRoZSBuZXh0IHR3byBsaW5lcw0KICAgICMjbXRyeSAlPiUgdHVuZSgpLA0KICAgICMjdHJlZXMgJT4lIHR1bmUoKSwNCiAgICBtdHJ5ID0gcm91bmQoc3FydCgyMykpLA0KICAgIHRyZWVzID0gNTAwLA0KICAgIG1pbl9uID0gMQ0KICApICU+JSANCiAgc2V0X2VuZ2luZSgicmFuZ2VyIiwgaW1wb3J0YW5jZSA9ICJwZXJtdXRhdGlvbiIsIHNhbXBsZS5mcmFjdGlvbiA9IDAuNjMyLA0KICAgICAgICAgICAgIHJlcGxhY2UgPSBGQUxTRSwgd3JpdGUuZm9yZXN0ID0gVCwgc3BsaXRydWxlID0gImV4dHJhdHJlZXMiLA0KICAgICAgICAgICAgIHNjYWxlLnBlcm11dGF0aW9uLmltcG9ydGFuY2UgPSBGQUxTRSkgIyB3ZSBhZGQgZW5naW5lIHNwZWNpZmljIHNldHRpbmdzDQpgYGANCg0KIyMjIFNldHRpbmdzIGZvciB0dW5pbmcNCg0KSWYgd2Ugd2FudCB0byB0dW5lIHRoZSBtb2RlbCwgdGhlbiB1bmNvbW1lbnQgdGhlIGxpbmVzIGJlbG93LiBJdCBpcyBpbXBvcnRhbnQgdG8gdXNlIGFuIG10cnkgdGhhdCBob3ZlcnMgYXJvdW5kIHRoZSByb3VuZChzcXJ0KFZhcmlhYmxlcykpLiBJZiB5b3UgdXNlIGFsbCBhdmFpbGFibGUgdmFyaWFibGVzLCB0aGVuIHlvdXIgZm9yZXN0IGlzIGJpYXNlZCBhcyBpdCBpcyBhYmxlIHRvIHNlZSBhbGwgcHJlZGljdG9ycy4gRm9yIG51bWJlciBvZiB0cmVlcywgbG93IG51bWJlcnMgYXJlIG5vdCBncmVhdCwgYXMgeW91IGNhbiBlYXNpbHkgdW5kZXJmaXQgdGhlIGRhdGEgYW5kIG5vdCBwcm9kdWNlIG1lYW5pbmdmdWwgcmVzdWx0cy4gTGFyZ2UgbnVtYmVycyBhcmUgZmluZSBhbmQgUmFuZG9tIEZvcmVzdHMgZG8gbm90IG92ZXJmaXQgKGluIHRoZW9yeSkuIA0KDQpUaGUgZnVsbCBkYXRhc2V0IGhhcyBhcm91bmQgMjAwMCBvYnNlcnZhdGlvbnMsIGFuZCAyMyBwcmVkaWN0b3JzICh3ZWxsIGV2ZW4gbW9yZSwgYnV0IGxldCdzIGlnbm9yZSBpdCBmb3IgdGhlIG1vbWVudCkuIEkgdHVuZWQgYG10cnlgIHRvIGJlIGJldHdlZW4gNCBhbmQgNiwgYW5kIGB0cmVlc2AgdG8gYmUgYmV0d2VlbiAxMDAwIGFuZCA1MDAwIGluIGEgMzAgc3RlcCBpbmNyZW1lbnQuIEluIHRvdGFsLCB3aXRoIGEgMTAtZm9sZHMgY3Jvc3MgdmFsaWRhdGlvbiwgSSBncmV3IDMwIHJhbmRvbSBmb3Jlc3RzIG9uIGVhY2ggZm9sZCBmb3IgYSB0b3RhbCBvZiAzMDAgUmFuZG9tIEZvcmVzdHMgb24gdGhlIHRyYWluaW5nIHNldCEhISBUaGlzIG9mIGNvdXJzZSB3aWxsIHRha2UgYSBsb29vb29vbmcgdGltZSB0byBjb21wdXRlIG9uIHlvdXIgY29tcHV0ZXIgaWYgdXNpbmcgb25lIHRocmVhZC4gU28gdXNlIHBhcmFsbGVsIGNvbXB1dGluZyBvciBhIGNsdXN0ZXIuIFdoZW4gcnVubmluZyBpbiB0aGUgY2x1c3RlciB3aXRoIDIwIGNvcmVzLCBlYWNoIHdpdGggMTFHQiBSQU1zLCBhbmQgaXQgdG9vayBhcm91bmQgMjYwLjQ0MiBzZWNvbmRzIHRvIHJ1biB3aXRoIDIyMEdCIFJBTVMhIE9mIGNvdXJzZSwgd2l0aCBzbWFsbGVyIFJBTXMgYW5kIG51bWJlciBvZiBjb3JlcywgdGhlIGNvZGUgd2lsbCBzdGlsbCBydW4gYnV0d2lsbCB0YWtlIGxvbmdlci4gDQoNCg0KYGBge3J9DQojIyBzZXQuc2VlZCgxMjM0NTYpDQojI2dyaWR5X3RpZHltIDwtIGdyaWRfcmFuZG9tKA0KIyMgIG10cnkoKSAlPiUgcmFuZ2Vfc2V0KGMoNCwgNikpLA0KIyMgIHRyZWVzKCkgJT4lIHJhbmdlX3NldChjKDEwMDAsIDUwMDApKSwNCiMjICBzaXplID0gMzANCiMjICApDQpgYGANCg0KIyMjIFdvcmtmbG93DQoNCk5vdyB3ZSBkZWZpbmUgdGhlIHdvcmtmbG93IGFkZGluZyB0aGUgYHJlY2lwZWAgYW5kIHRoZSBgbW9kZWxgLg0KDQpgYGB7cn0NCnNldC5zZWVkKDEyMzQ1NikNCndrZmxfdGlkeW0gPC0gd29ya2Zsb3coKSAlPiUgDQogIGFkZF9yZWNpcGUocmVjaXBlKSAlPiUgDQogIGFkZF9tb2RlbChlbmdpbmVfdGlkeW0pDQpgYGANCg0KIyMjIFR1bmluZyBhbmQgcnVubmluZyBtb2RlbA0KDQpIZXJlIHdlIHJ1biB0aGUgbW9kZWwgc3RhcnRpbmcgd2l0aCB0aGUgd29ya2Zsb3csIHRoZSBjcm9zcy12YWxpZGF0aW9uIHNhbXBsZSwgdGhlIHR1bmluZyBwYXJhbWV0ZXJzIGFuZCBhc2tpbmcgZm9yIHNwZWNpZmljIG1ldHJpY3MuIEJlbG93LCB3ZSByZWNlaXZlIG9uZSB3YXJuaW5nOg0KDQoxLiBXZSBkaWQgbm90IGRlZmluZSBhbnkgdHVuaW5nLCBhbmQgcmVjZWl2ZSBhIHdhcm5pbmcgYWJvdXQgaXQuDQoNCkFib3ZlLCB3ZSBhZGRlZCBhbiBvcHRpb24gdG8gc3VwcHJlc3MgYW55IHdhcm5pbmcgbWVzc2FnZXMgZnJvbSBgZG9GdXR1cmVgLiBJZiB5b3UgZG8gbm90IHVzZSB0aGF0IG9wdGlvbiwgeW91IG1heSByZWNlaXZlIGEgd2FybmluZyB0aGF0IHNvbWUgdGhyZWFkcyBhcmUgbm90IHVzaW5nIGNvcnJlY3QgcmFuZG9tIHNlZWRzLiBUaGlzIGlzIGEgZmFsc2UtcG9zaXRpdmUgd2VsbCBrbm93biB0byB0aGUgZGV2ZWxvcGVycy4gRm9yIG1vcmUgZGV0YWlscywgc2VlIFt0aGlzIGxpbmtdKGh0dHBzOi8vdHVuZS50aWR5bW9kZWxzLm9yZy9yZWZlcmVuY2UvY29udHJvbF9ncmlkLmh0bWwpLCBidXQgYWxzbyB0aGVpciBnaXRodWIgcGFnZTsgc28geW91IGNhbiBpZ25vcmUgdGhlIHdhcm5pbmcuIA0KDQpgYGB7cn0NCnNldC5zZWVkKDEyMzQ1NikNCnN5c3RlbS50aW1lKGdyaWRfdGlkeW0gPC0gDQogIHR1bmVfZ3JpZCh3a2ZsX3RpZHltLCANCiAgICAgICAgICAgIHJlc2FtcGxlcyA9IHRyYWluX2N2LA0KICAgICAgICAgICAgIyMgaWYgdHVuaW5nIG10cnkgYW5kIHRyZWVzLCB1bmNvbW1lbnQgdGhlIGxpbmUgYmVsb3cNCiAgICAgICAgICAgICNncmlkID0gZ3JpZHlfdGlkeW0sDQogICAgICAgICAgICBtZXRyaWNzID0gbWV0cmljX3NldChhY2N1cmFjeSwgcm9jX2F1Yywgc2Vucywgc3BlYyksDQogICAgICAgICAgICBjb250cm9sID0gY29udHJvbF9ncmlkKHNhdmVfcHJlZCA9IFRSVUUsIHBhcmFsbGVsX292ZXIgPSAicmVzYW1wbGVzIikpDQopDQpwcmludChncmlkX3RpZHltKQ0KYGBgDQoNCg0KIyMjIEZpbmFsaXNlIG1vZGVsDQoNCldlIG9idGFpbiB0aGUgYmVzdCBwZXJmb3JtaW5nIG1vZGVsIGZyb20gY3Jvc3MtdmFsaWRhdGlvbiwgdGhlbiBmaW5hbGlzZSB0aGUgd29ya2Zsb3cgYnkgcHJlZGljdGluZyB0aGUgcmVzdWx0cyBvbiB0aGUgdGVzdGluZyBzZXQgYW5kIG9idGFpbiB0aGUgcmVzdWx0cyBvZiB0aGUgYmVzdCBwZXJmb3JtaW5nIG1vZGVsDQoNCmBgYHtyfQ0Kc2V0LnNlZWQoMTIzNDU2KQ0KY29sbGVjdF9tZXRyaWNzKGdyaWRfdGlkeW0pDQpncmlkX3RpZHltX2Jlc3QgPC0gc2VsZWN0X2Jlc3QoZ3JpZF90aWR5bSwgbWV0cmljID0gInJvY19hdWMiKQ0KZ3JpZF90aWR5bV9iZXN0DQp3a2ZsX3RpZHltX2Jlc3QgPC0gZmluYWxpemVfd29ya2Zsb3cod2tmbF90aWR5bSwgZ3JpZF90aWR5bV9iZXN0KQ0Kd2tmbF90aWR5bV9maW5hbCA8LSBsYXN0X2ZpdCh3a2ZsX3RpZHltX2Jlc3QsIHNwbGl0ID0gdHJhaW5fdGVzdF9zcGxpdCkNCmBgYA0KDQojIyBSZXN1bHRzDQoNCkZvciB0aGUgcmVzdWx0cywgd2UgY2FuIG9idGFpbiB2YXJpb3VzIG1ldHJpY3Mgb24gdGhlIHRyYWluaW5nIGFuZCB0ZXN0aW5nIHNldHMuIA0KDQojIyMgQ3Jvc3MtdmFsaWRhdGlvbiBvbiB0cmFpbmluZyBzZXQNCg0KIyMjIyBBY2N1cmFjeQ0KDQpgYGB7cn0NCnBlcmNlbnQoc2hvd19iZXN0KGdyaWRfdGlkeW0sIG1ldHJpYyA9ICJhY2N1cmFjeSIsIG4gPSAxKSRtZWFuKQ0KYGBgDQoNCiMjIyMgUk9DLUFVQw0KDQpgYGB7cn0NCiMgQ3Jvc3MtdmFsaWRhdGVkIHRyYWluaW5nIHBlcmZvcm1hbmNlDQpzaG93X2Jlc3QoZ3JpZF90aWR5bSwgbWV0cmljID0gInJvY19hdWMiLCBuID0gMSkkbWVhbg0KYGBgDQoNCg0KIyMjIyBTZW5zaXRpdml0eQ0KDQpgYGB7cn0NCnNob3dfYmVzdChncmlkX3RpZHltLCBtZXRyaWMgPSAic2VucyIsIG4gPSAxKSRtZWFuDQpgYGANCg0KIyMjIyBTcGVjaWZpY2l0eQ0KDQpgYGB7cn0NCnNob3dfYmVzdChncmlkX3RpZHltLCBtZXRyaWMgPSAic3BlYyIsIG4gPSAxKSRtZWFuDQpgYGANCg0KIyMjIFByZWRpY3Rpb25zIHRlc3Rpbmcgc2V0DQoNCiMjIyMgT3ZlcmFsbA0KDQpgYGB7cn0NCndrZmxfdGlkeW1fZmluYWwkLm1ldHJpY3MNCmBgYA0KDQojIyMjIEFjY3VyYWN5DQoNCmBgYHtyfQ0KI2FjY3VyYWN5DQpwZXJjZW50KHdrZmxfdGlkeW1fZmluYWwkLm1ldHJpY3NbWzFdXSQuZXN0aW1hdGVbWzFdXSkNCmBgYA0KDQojIyMjIFJPQy1BVUMNCg0KDQpgYGB7cn0NCiNyb2MtYXVjDQp3a2ZsX3RpZHltX2ZpbmFsJC5tZXRyaWNzW1sxXV0kLmVzdGltYXRlW1syXV0NCmBgYA0KDQojIyMgQ29uZnVzaW9uIE1hdHJpeCB0cmFpbmluZyBzZXQNCg0KYGBge3Igd2FybmluZz1GQUxTRSwgbWVzc2FnZT1GQUxTRSwgZXJyb3I9RkFMU0UsIGZpZy5oZWlnaHQgPSA2LCBmaWcud2lkdGggPSA4fQ0Kd2tmbF90aWR5bV9maW5hbCQucHJlZGljdGlvbnNbWzFdXSAlPiUNCiAgY29uZl9tYXQoY29udGV4dCwgLnByZWRfY2xhc3MpICU+JQ0KICBwbHVjaygxKSAlPiUNCiAgYXNfdGliYmxlKCkgJT4lDQogIGdyb3VwX2J5KFRydXRoKSAlPiUgIyBncm91cCBieSBUcnV0aCB0byBjb21wdXRlIHBlcmNlbnRhZ2VzDQogIG11dGF0ZShwcm9wID1wZXJjZW50KHByb3AudGFibGUobikpKSAlPiUgIyBjYWxjdWxhdGUgcGVyY2VudGFnZXMgcm93LXdpc2UNCiAgZ2dwbG90KGFlcyhQcmVkaWN0aW9uLCBUcnV0aCwgYWxwaGEgPSBwcm9wKSkgKw0KICBnZW9tX3RpbGUoc2hvdy5sZWdlbmQgPSBGQUxTRSkgKw0KICBnZW9tX3RleHQoYWVzKGxhYmVsID0gcHJvcCksIGNvbG91ciA9ICJ3aGl0ZSIsIGFscGhhID0gMSwgc2l6ZSA9IDgpDQpgYGANCg0KDQojIyMgVmFyaWFibGUgSW1wb3J0YW5jZQ0KDQojIyMjIEJlc3QgMTANCg0KYGBge3J9DQp2aXAocHVsbF93b3JrZmxvd19maXQod2tmbF90aWR5bV9maW5hbCQud29ya2Zsb3dbWzFdXSkpDQpgYGANCg0KDQojIyMjIEFsbCBwcmVkaWN0b3JzDQoNCg0KYGBge3J9DQp2aXAocHVsbF93b3JrZmxvd19maXQod2tmbF90aWR5bV9maW5hbCQud29ya2Zsb3dbWzFdXSksIG51bV9mZWF0dXJlcyA9IDIzKQ0KYGBgDQoNCg0KIyMjIEdhaW5zIGN1cnZlcw0KDQpUaGlzIGlzIGFuIGludGVyZXN0aW5nIGZlYXR1cmVzIHRoYXQgc2hvdyBob3cgbXVjaCBpcyBnYWluZWQgd2hlbiBsb29raW5nIGF0IHZhcmlvdXMgcG9ydGlvbnMgb2YgdGhlIGRhdGEuIFdlIHNlZSBhIGdyYWR1YWwgaW5jcmVhc2UgaW4gdGhlIHZhbHVlcy4gV2hlbiA1MCUgb2YgdGhlIGRhdGEgd2VyZSB0ZXN0ZWQsIGFyb3VuZCA4MyUgb2YgdGhlIHJlc3VsdHMgd2l0aGluIHRoZSBub24tZ3V0dHVyYWwgY2xhc3Mgd2VyZSBhbHJlYWR5IGlkZW50aWZpZWQuIFRoZSBtb3JlIHRlc3Rpbmcgd2FzIHBlcmZvcm1lZCwgdGhlIG1vcmUgY29uZmlkZW5jZSBpbiB0aGUgcmVzdWx0cyB0aGVyZSBhcmUgYW5kIHRoZW4gd2hlbiA4NC45NiUgb2YgdGhlIGRhdGEgd2VyZSB0ZXN0ZWQsIDEwMCUgb2YgdGhlIGNhc2VzIHdlcmUgZm91bmQuIA0KDQpgYGB7cn0NCndrZmxfdGlkeW1fZmluYWwkLnByZWRpY3Rpb25zW1sxXV0gJT4lDQogIGdhaW5fY3VydmUoY29udGV4dCwgYC5wcmVkX05vbi1HdXR0dXJhbGApICU+JQ0KICBhdXRvcGxvdCgpIA0KYGBgICAgICAgIA0KDQojIyMgUk9DIEN1cnZlcw0KDQpgYGB7cn0NCndrZmxfdGlkeW1fZmluYWwkLnByZWRpY3Rpb25zW1sxXV0gJT4lDQogIHJvY19jdXJ2ZShjb250ZXh0LCBgLnByZWRfTm9uLUd1dHR1cmFsYCkgJT4lDQogIGF1dG9wbG90KCkgDQpgYGAgDQoNCg0KDQojIHNlc3Npb24gaW5mbw0KDQpgYGB7ciB3YXJuaW5nPUZBTFNFLCBtZXNzYWdlPUZBTFNFLCBlcnJvcj1GQUxTRX0NCnNlc3Npb25JbmZvKCkNCmBgYA0KDQo=