*
Concepts
*
Settings
 

Setting up Environmental Evaluations

In risk analysis, the consequences of failure are determined for each important failure mode. Any of the following types of effects can be included in the risk analysis:
•
Environmental
•
Health and safety
•
Economic
•
Reputation
This topic provides background information and explains how to set up an evaluation that analysts can use to assess the severity of environmental effects. This topic covers:
•
Hazards and Consequences
•
Mitigating Factors
•
Anatomy of an Evaluation
•
Simple and Detailed Evaluations
•
Category Answer Matrix
•
Inspection Factors and Intervals
•
Controlling the Availability of Categories
•
Example Evaluation Form
It explains how:
•
To Set up an Environmental Evaluation
•
To Create Consequence Categories and Questions
•
To Create Mitigation Categories and Questions
Tip: APM comes with an example evaluation form, which you can modify for your organization or use as a model for a new evaluation.

Hazards and Consequences

Environmental incidents are an important category to consider when determining the overall consequence of a failure mode. Typically, two types of environmental incidents are considered:
•
Release of liquids that can cause soil and water pollution
•
Release of gases that can cause atmospheric pollution
The following are examples of environmental consequences:
Potential Impact
Description
No / slight effect
Local environmental damage, usually within the enclosed space or system. Negligible financial impact.
Minor effect
Contamination; damage sufficient to attack the environment. Typically a single complaint or single breach of statutory limits.
Localized effect
Limited loss of known toxic discharge but repeated breaches of statutory limits. Damage affects areas outside the enclosed space.
Major effect
Severe environmental damage. Extensive measures are required to restore the contaminated environment. Extended breach of statutory limits.
Severe effect
Persistent severe environmental damage or nuisance extending over a large area. A major loss to the organization in terms of commercial, recreational, or nature conservancy. Constant or extremely numerous breaches of statutory limits.

Mitigating Factors

Mitigating factors can be considered when assessing environmental consequences, for example:
•
The possibility of averting the hazardous event
•
The location of a toxic liquid spill helps to contain the spread

Anatomy of an Evaluation

When setting up the evaluation, you will define consequence categories, for example, liquid spill or gas emission. For each category, create questions or impact statements. Assign a ranking number to each question to indicate the severity of the effect. Typically, the larger the number, the greater the severity. Here are examples of severities and their scores:
•
Severe – Massive environmental damage (5)
•
High – Major environmental damage (4)
•
Medium – Localized environmental damage (3)
•
Low – Minor environmental damage (2)
•
Negligible – No or negligible environmental damage (1)
As an analyst goes through the evaluation and selects statements, APM uses the ranking numbers to calculate the overall severity for environmental consequences. The severity is based on one of:
•
The answer with the highest score
•
The sum of the scores for the answers
•
The answer with the lowest score
For example, when “highest score” is used, if statements for three categories are selected in a simple evaluation, two of which have a result of “Negligible” and one with a result of “High”, the score for the evaluation as a whole will be “High”. When the “sum of scores” option is used, the numbers assigned to the questions are added and the corresponding severity is displayed. This will be the severity used in the risk analysis.
When individual rankings are summed (or the lowest score is used), you can add one or more mitigation categories to identify variables that lower the severity. Mitigating questions or statements are assigned negative numbers to lower the overall severity score. For example:
•
Location of spill – no chance of reaching ground water or surface (-1)
When setting up a mitigation category, you can specify that the mitigation score be applied either to the total consequence of the evaluation or to a specific category. For example, “Location of spill” could affect the Liquid Spill consequence score only.
For more information, see To Create Mitigation Categories and Questions.

Simple and Detailed Evaluations

When designing an evaluation, you can specify that it supports simple evaluations (one level of questions), detailed evaluations (one or two levels of questions), or both. When two levels of questions are defined, the first set usually presents the problems and the second set presents the volume or size of the problem. For the Fire category, for example, first-level questions could deal with flammability and second-level questions with the volume of released fluid. When the evaluation supports both levels, the user can click Simple or Detailed in the questionnaire, depending on the complexity of the failure mode.
To set up a detailed evaluation with two levels, you must generate the question matrix. APM creates an entry for each combination of level 1 and level 2 questions. You can modify each entry’s sequence number, add an abbreviation, and set the ranking number that will be assigned to the category when the user selects the combination of statements. Here is an example of an entry:

Category Answer Matrix

When setting up questionnaires for risk analysis, you can use the category answer matrix on simple evaluations. You can define questions for as many as four categories, show examples for each category, and select probabilities to use in the matrix.
APM generates an answer matrix that takes into account the categories, category questions, and probabilities. For each matrix entry, you can select a severity ranking and safety integrity level, if applicable.
This type of evaluation must be used for SIF analysis and can also be used to design questionnaires for other analysis types.
The category answer matrix is only supported for simple evaluations with one level of questions. Evaluations must be presented as embedded forms, meaning that the user opens the Maintenance Action Plan window, selects the Risk tab, and then selects options. This choice can be set in the risk options of the analysis, analysis type, or asset type.
When embedded forms are specified for a strategy development analysis, you must set up an economic evaluation using a category answer matrix. When pop-up questionnaires (rather than embedded forms) are specified for an analysis, APM provides simple and detailed worksheets to perform the evaluation.
For more information, see Setting up Evaluations with the Category Answer Matrix.

Inspection Factors and Intervals

Confidence evaluations can result in an inspection factor (for example, 0.5) or an inspection interval (for example, every five years). When setting evaluation properties, you can specify that inspection factors, inspection intervals, or both can be assigned to questions. In the evaluation’s policies, you can stipulate whether the lowest or highest inspection factor is selected and whether the longest or shortest inspection interval is selected for the evaluation. These values are then used in the confidence evaluation to calculate the failure mode’s inspection factor and interval.

Controlling the Availability of Categories

You can control whether or not a category is available in an evaluation by specifying:
•
The primary analysis asset’s material type or classification
•
One or more evaluation groups assigned to damage mechanism library entries (RBI analyses only)
•
Failure modes created from one or more of the specified failure modes library entries (RBI analyses only)
•
Asset types assigned one or more evaluation groups
•
One or more asset types

Using Lookup Tables and Calculations

You can incorporate a lookup table and/or calculation in a category to automatically assess severity ranking. For example, use the environmental toxicity lookup table to determine a ranking. For information, see Setting up Consequence Severity Evaluations to use Lookup Tables.

Example Evaluation Form

In order for the evaluation to be available in the Maintenance Action Plan window, it must be selected in the risk options for the analysis, analysis type, or asset type. The following example is a detailed evaluation presented as a pop-up dialog or online questionnaire. The analyst opens the Maintenance Action Plan window and selects the Criticality view. For example:
The analyst clicks Environmental to open the questionnaire:
Tip: Evaluations can also be shown as “embedded” forms, meaning that the user opens the Maintenance Action Plan window, selects the Risk tab, and then selects options. This choice can be set in the risk options for the analysis, analysis type, or asset type.
The analyst can refer to the Asset Properties, History, and Barriers tabs for information to aid in the evaluation, for example, historical inspections, failures, and work performed. APM provides this information automatically, based on the asset’s data. When designing the evaluation, you can add the Samples tab and provide examples. You can also choose to show asset fluid information, degradation rates, and calculations (Liquid release or flash calculation for LPG).
If different evaluation types have been defined in the form, the analyst can select Simple or Detailed, as required by the complexity of the failure mode.
To perform the evaluation, the analyst selects statements, enters notes, and uses the arrow buttons to move between categories.
As the analyst moves through the analysis, the Severity box displays the current calculation of severity based on the selections. The Selections tab displays the categories, selected statements, and the ranking.
The analyst can select the team member performing the evaluation from the Analyzed by list and provide additional information about the analysis in the Notes box. Notes are collected and available in several locations.
When the analyst completes the pop-up questionnaire and clicks OK, the evaluation form closes and the result (for example, slight effect or major effect) is selected in the risk matrix. For example:

To Set up an Environmental Evaluation

1.
On the site’s Strategy Development view, select the Settings tab, the Severities tab, and the Severities settings node in the tree.
Tip: You can also select the site’s Administration menu, Strategy Development Settings, Risk Analysis and then Severities. The Strategy Development - Severities Settings dialog appears.
2.
Select the Environmental Questionnaires tab:
3.
Click New. The Evaluation Form Properties window appears.
4.
Enter the following information:
Setting Name
Description
Form name
Descriptive name for the evaluation.
Evaluates
Indicates the type of form:
•
Health and safety consequences
•
Environmental consequences
•
Economic consequences
•
Reputation consequences
•
Probability of failure
•
Confidence
Evaluation types
You can restrict the questionnaire to a simple or detailed evaluation.
Severity selection policy
The options for calculating the result of the questionnaire are:
•
Answer with the highest score is used
•
Sum of answers
•
Answer with the lowest score is used
•
Category answer matrix (not available for probability or confidence evaluations). This option is only available when “Only simple evaluations are supported” is selected.
Note: For related information, see Setting up Evaluations with the Category Answer Matrix.
5.
Select the Policies tab.
6.
Enter the following information:
Setting Name
Description
Inspection factor selection policy
The options for selecting inspection factors are:
•
Inspection factor is not applicable (default)
•
Lowest inspection factor is selected – The selected statement with the lowest inspection factor supplies the inspection factor
•
Highest inspection factor is selected – The selected statement with the highest inspection factor supplies the inspection factor
Inspection interval selection policy
The options for selecting inspection intervals are:
•
Inspection intervals are not applicable (default)
•
Shortest inspection interval is used – The selected statement with the shortest inspection interval supplies inspection interval
•
Longest inspection interval is used – The selected statement with the longest inspection interval supplies the inspection interval
Now, you can add consequence categories, as explained next.

To Create Consequence Categories and Questions

1.
On the Evaluation Form Properties dialog, select the Categories tab.
2.
Click New Consequences Category. The FM Consequences Evaluation Category window appears.
Note: For information about creating a mitigation category, see To Create Mitigation Categories and Questions.
3.
Enter the following information:
Setting Name
Description
Category name
Descriptive name for the category, for example, Operating Temperature, Fire, or Safety Consequence.
Sequence
The sequence number determines the order of categories in the form.
Simple evaluation heading
Heading that appears at the top of the category in a simple evaluation form.
Detailed evaluation, level 1 heading
When the form supports two levels of questions, this is the heading that appears at the top of the category in a detailed evaluation form.
Detailed evaluation, level 2 heading
When the form supports two levels of questions, this is the heading that appears at the top of the second area in a detailed evaluation form.
4.
Click New. The Evaluation Question window appears.
5.
Enter the following information:
Setting Name
Description
Sequence
The sequence number determines the order of the statement in the category. Statements are presented in descending order. That is, the statement with the highest sequence number appears first in the list of statements.
Statement
The statement that appears in the form, which the user selects if it is applicable. An example for operating temperature is “50 - 175 C or 120 - 350 F or cycling sweating conditions”.
Abbreviation
Short identifier for the question.
Ranking
Number that represents the question’s importance in calculating the consequence. The higher the number, the greater its severity.
Inspection factor
The inspection factor (for example, 0.5) assigned to this evaluation statement.
Inspection interval
The interval between inspections assigned to this evaluation statement.
Note: Specify abbreviated frequencies (for example, “1 yr”) to ensure that inspection intervals will be shown in printed reports.
Life adjustment factor
The life adjustment factor assigned to this evaluation statement.
Probability of failure lower limit
If time between failure (TBF) is used to determine probability of failure, you can set the lower limit for the estimated TBF. To use this option, enter a number and select a time-based unit of measure.
6.
Select the Evaluation tab. For example:
Setting Name
Description
Question level used with
If the question is for a detailed form, specify whether it is to appear in the first or second level.
Evaluation level
Specify whether the question is to be used on all evaluations, simple evaluations only, or detailed evaluations only.
7.
Click OK. The question is added to the Questions tab.
8.
Repeat steps 4 to 7 for each of the questions in the category.
9.
If the evaluation supports simple forms only, skip to step 12.
10.
If the evaluation supports detailed forms, select the Matrix tab. Click Generate. APM displays a message listing the entries that were generated. For example:
11.
Click OK to close the message. Double-click each entry in turn to open its Severity Evaluation Question Matrix Entry dialog. For example:
Note: The first question has been designated level 1. The second question has been designated level 2. Both questions must have an evaluation level of either “Both levels” or “Detailed evaluations only” to be included in the matrix.
•
Enter a sequence number to specify the entry’s location in the matrix.
•
Provide the entry with a short form for display.
•
Enter the severity ranking number for the entry. When the user selects the first and second questions during a detailed evaluation, this severity ranking is assigned for that category.
•
Click OK.
12.
On the FM Consequences Evaluation Category dialog, select the Details tab to set options for supporting information. For example:
13.
Provide the following information:
Setting Name
Description
Show the supporting information notebook
When this option is selected, the supporting information notebook is displayed in the questionnaire.
Show samples with simple evaluation
When this option is selected, the simple form of the evaluation shows examples.
Show samples with detailed evaluation
When this option is selected, the detailed form of the evaluation shows examples.
Sample section heading
The heading that appears at the top of the Samples tab for this category in the questionnaire.
Show asset properties
When this option is selected, the supporting information notebook contains the Asset Properties tab. This tab provides the failure mode asset’s properties on several tabs.
Show asset fluid information when available
When this option is selected, the asset’s fluid information is displayed in the questionnaire.
Show asset history
When this option is selected, the supporting information notebook contains the History tab. This tab provides the failure mode asset’s checksheets, failures, work orders, and work requests.
Show barriers
When this option is selected, the supporting information notebook contains the Barriers tab. This tab lists the failure mode asset’s failure barriers.
Show degradation rates when available
When this option is selected, the asset’s degradation rates are displayed in the questionnaire.
Show damage mechanism attachments
When this option is selected, the supporting information notebook contains the Attachments tab. If the RBI failure mode was created from a damage mechanism, this tab lists the damage mechanism’s attachments.
14.
For each example, click New. The Consequence Sample dialog appears:
•
Enter the sequence number that determines the sample’s order in the list.
•
In the Sample box, enter the example. Click OK. The sample is added to the Examples table.
15.
Select the Calculations tab if you wish to show a liquid release or gas spill flash calculation with the category.
Note: APM provides liquid release and sample flash calculations. To create or edit calculations, select the Strategy Development view and then the Settings, Severities, and Calculations tabs. Click New to create either a liquid release calculation or a flash calculation for LPG.
•
Select Liquid release calculation or Flash calculation for LPG. For example:
•
Select the calculation from the list.
•
By default, the calculation is shown with simple and detailed evaluations. You can clear an option as appropriate.
Tip: Double-click the calculation’s icon to view its properties.
16.
Select the Materials tab to set up restrictions for material types and classifications, if applicable. For example, you could specify that the category is not available for assets made of stainless steel.
17.
You can restrict the use of the category according to failure mode, asset type, or evaluation group. Select the Failure Modes tab.
18.
Select one of the following:
•
All failure modes – There are no restrictions on the category based on the failure mode.
•
Selected evaluation groups – A table appears listing the evaluation groups defined for the site. Select the appropriate evaluation groups.
Note: Evaluation groups are assigned to asset types in their strategy development settings. They can also be assigned to entries in the damage mechanism library (RBI analysis).
•
Selected failure modes – A table appears listing library failure modes. Select the appropriate library entries.
19.
Select the Asset Types tab to restrict the category to specific asset types or asset types in specific evaluation groups.
20.
Select one of the following:
•
All asset types – There are no restrictions on the category based on the asset type.
•
Selected evaluation groups – A table appears listing the evaluation groups defined for the site. Select the appropriate evaluation groups.
Note: Evaluation groups are assigned to asset types in their strategy development settings. They can also be assigned to entries in the damage mechanism library (RBI analysis).
•
Selected asset types – A table appears listing asset types for the site. Select the appropriate asset types.
21.
Click OK. The category is added to the Evaluation categories table. For example:
Tip: While you are developing an evaluation, you can mark a category as inactive until it is ready to be used in risk analyses. On the Categories tab, select the category in the table and click Mark as Inactive. The Mark as Inactive window appears, where you can enter a comment. When you click OK, a confirmation message appears. Click OK. The category’s Active Status in the table is shown as “Inactive”. When you are ready, click Mark as Active to make the category available.
22.
To view a list of the questions on the form, select the Questions tab. To view the compiled list of matrix entries for detailed evaluations, select the Question matrix tab.
23.
Select the Description tab to enter additional information.
The next section explains how to add a mitigating factor to the categories.

To Create Mitigation Categories and Questions

1.
In the Evaluation Form Properties window, select the Categories tab. Click New Mitigation Category. The FM Consequences Evaluation window appears.
2.
Enter the following information:
Setting Name
Description
Category name
Descriptive name for the category.
Sequence
The sequence number determines the order of categories in the form.
Simple evaluation heading
Heading that appears at the top of the category in a simple evaluation form.
Detailed evaluation, level 1 heading
When the form supports two levels of questions, this is the heading that appears at the top of the category in a detailed evaluation form.
Detailed evaluation, level 2 heading
When the form supports two levels of questions, this is the heading that appears at the top of the second area in a detailed evaluation form.
3.
Click New. The Evaluation Question window appears.
4.
Enter the following information:
Setting Name
Description
Sequence
The sequence number determines the order of the statement in the category. Statements are presented in descending order. That is, the statement with the highest sequence number appears first in the list of statements.
Statement
The statement that appears in the form, which the user selects if it is applicable. An example of a mitigating factor with the heading “Possibility of diverting danger” is “In some circumstances (more than 25% of cases)”.
Abbreviation
Short identifier for the question.
Mitigation score
Negative number that represents the mitigating factor’s ability to lessen the severity of the consequence.
Probability of failure lower limit
If time between failure (TBF) is used to determine probability of failure, you can set the lower limit for the estimated TBF. To use this option, enter a number and select a time-based unit of measure.
5.
Select the Evaluation tab.
Setting Name
Description
Question level used with
If the question is for a detailed form, specify whether it is to appear in the first or second level.
Evaluation level
Specify whether the question is to be used on all evaluations, simple evaluations only, or detailed evaluations only.
6.
Click OK. The question is added to the Questions tab.
7.
Repeat steps 3 to 6 for each of the statements in the category.
8.
When you have created all of the mitigation questions, you can generate and edit the question matrix. See To Create Consequence Categories and Questions for more information.
9.
Select the Details tab to add samples and additional information.
10.
Select the Mitigation Options tab.
11.
By default, the mitigation score is applied to the total consequences for the evaluation. To apply the mitigation score to a specific category, click Consequence category and select the category from the list.
12.
You can select calculations, materials types, failure modes, and asset types. See To Create Consequence Categories and Questions for more information.
When you have created all of the mitigation questions, you can generate and edit the question matrix, add samples, calculations, materials types, and failure mode and asset type restrictions. See the steps in To Create Consequence Categories and Questions for more information.
13.
When you have finished adding categories, click OK. The form is added to the Environmental Questionnaires tab.
Note: When you have set up the evaluation, you can assign the questionnaire to analysis types and asset types. For more information, see:
•
Setting Risk Analysis Options for Analysis Types
•
Setting Strategy Development Options on Asset Types