Challenges of Applied Risk Management: Challenges of Applied Risk Management by Ralph L. Keeney Fuqua School of Business Duke University


What is Applied Risk Management: What is Applied Risk Management Applied Risk Management is making decisions about risks. It involves Identifying and analyzing risks Identifying and evaluating alternatives to deal with these risks Choosing alternatives to manage risks Communicating about the decision. ARM uses models and analyses


Objectives of the Presentation: Objectives of the Presentation Raise a few general issues about analysis Outline applied risk management Suggest important aspects of the art of applying risk management Stimulate some thought (hopefully) Have some fun!


Why Bother to Make Decisions?: Why Bother to Make Decisions? Your decisions are the only way that you can purposefully influence anything. Anything includes the quality of your life, your family, your organization, your country, or your world is through the decisions you make. Everything else just happens.


True or False: True or False It is reasonably likely that a moderate to large hurricane will cause significant damage to the Mid-Atlantic region sometime in the foreseeable future.


Please Define the Following: Please Define the Following reasonably likely moderate to large hurricane significant damage the Mid-Atlantic region the foreseeable future.


True or False: True or False It is reasonably likely that there will be a moderate to large earthquake in the San Francisco Bay Area in the near future.


Please Define the Following: Please Define the Following Reasonably likely Moderate to large earthquake San Francisco Bay Area Near future


Why Build a Model and Do Analysis?: Why Build a Model and Do Analysis? The real problem is too complex to understand all of its parts and their relationships. A model is a simplification of the problem. The model must address the complexities of the problem in order to provide insights about them. You can analyze the model to produce insights relevant to the real problem.


Complexities of Risk Decisions: Complexities of Risk Decisions Multitude of impacts (multiple objectives) Some intangible impacts (hard to measure) Requires multiple disciplines Long-term impacts Uncertainties about impacts These are ‘factual’ uncertainties Professional judgments required Several Stakeholders Values are crucial Aggregation of impacts is necessary Policy (value) judgments required Some vexing value tradeoffs Unclear decision process and decision-makers Need to justify decisions


Decision Analysis Addresses the Complexities Inherent in ARM: Decision Analysis Addresses the Complexities Inherent in ARM A formalization of common sense applied to decision problems. A philosophy, articulated by logical axioms, and the techniques and procedures, based upon those axioms, for analyzing complexities inherent in decision problems. Decision analysis is prescriptive vs. descriptive.


Keys to Effective Decision Making: Keys to Effective Decision Making Work on the right decision problem Specify your objectives Create imaginative alternatives Understand the consequences Grapple with your tradeoffs Clarify your uncertainties Account for your risk tolerance Consider linked decisions


Elements of Decisions: Elements of Decisions Problem Objectives Alternatives Consequences Tradeoffs Uncertainty Risk Tolerance Linked Decisions Iteration among the elements is crucial in analysis


Problem: Problem Given a decision problem … then … Initial problem statement (frame) Reframed with objectives and alternatives What is the “risk” Who is/are the decision-maker(s) Who are the stakeholders


Problem Examples: Problem Examples Nuclear Repository: best site or portfolio of three New Orleans Levees: build a new levee, how high to build, how strong to build How to effectively communicate about a hurricane approaching Florida


Objectives: Objectives Objectives state what you want to achieve by making a decision Define objectives using a verb and an object Minimize environmental degradation Limit loss of life Minimize property damage Objectives are elicited from individuals


Ex: Choosing a Dissertation Topic : Ex: Choosing a Dissertation Topic ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ ________________________________________________________ Suppose you have identified ten potential dissertation topics and now have to pick one. Write down all the objectives that matter to you in selecting a dissertation topic.


Categories to Stimulate Dissertation Objectives: Categories to Stimulate Dissertation Objectives Academic Objectives While A Student ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ Academic Objectives After Graduating ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ We would like you to think a bit harder about the objectives that matter when selecting a dissertation topic. Below you will find four categories of objectives. Many dissertation objectives will fall into one of these four categories. Consider each category and list any additional objectives that matter to you that you did not list previously. Personal Objectives While A Student ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ Personal Objectives After Graduating ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ AA. ____________________________ AB. ____________________________ AC. ____________________________ AD. ____________________________ AE. ____________________________ AF. ____________________________ OTHER (any other overlooked criteria that are relevant to deciding on dissertation topic)


Dissertation Study: Dissertation Study  Is a topic acceptable to faculty for my doctorate  Is of interest to a faculty member that I want to serve as my advisor  Leads to multiple publishable papers  Is of interest to me/maintains my interest  Can be scoped/is tractable  Uses methods generalizable to other domains  Is interdisciplinary in nature/combines different areas  Utilizes my academic strengths  Does not require lots of data gathering  Does not require a lot of data analysis  Provides opportunity to improve my writing skills  Addresses issues involving collaboration between public and private sectors  Provides opportunity for sufficient quantitative analysis  Allows for personal time during ‘dissertation years’  Is of interest to the research/academic community  Is enjoyable to do  Helps me develop myself academically  Helps me build a coherent future research program  Helps me balance my career and personal life  Causes me to learn skills that will be applicable to future research  Prepares me as an independent researcher  Improves ability to write research proposals for funding  Puts me in control of the dissertation process (e.g., content, timing)  Is innovative/pursues a new idea/novel  Is insightful/has results that weren’t obvious prior to my work  Is relevant to real-world applications/is implementable  Will help people/organizations make better decisions  Addresses problems that are important  Influences the work of others  Stimulates discussion with colleagues  Leads to potentially fundable future research Provides basis for further research  Opens new areas of research after the dissertation  Results in an interesting job talk paper  Provides opportunities to work with top scholars Check all objectives that are important to your choice of a dissertation topic.


Dissertation Study Results: Dissertation Study Results self-generated objectives: 7.1 average unaided, 4.5 additional with categories relevant objectives: 21.3 average recognized objectives: 9.3 average importance: self-generated average 7.7 recognized objectives average 7.2 bogus objective average 2.1 baseline objective average 4.2


Identifying Objectives: Identifying Objectives From decision makers and stakeholders Get a complete set of objectives Distinguish between fundamental objectives and means objectives (max wind speed over land vs. fatalities)


Identifying Objectives Requires Work: Identifying Objectives Requires Work Individuals miss many objectives Experimental results Real-world decisions Devices to stimulate thinking Wish list Generic (health and safety, environmental, social, economic) Use alternatives Ask why? Involve multiple individuals


Alternatives: Alternatives Need to create alternatives Creative alternatives are needed Use objectives to stimulate thinking about alternatives (NYFD study) Iterate through decision analysis steps Delete poorer alternatives Embellish/change others


Exercise: Exercise What are the objectives? What are some alternatives? Problem: Effective Communication about an Approaching Hurricane


Consequences: Consequences Need to measure objectives Natural scales Constructed scales Proxy measures Use models, data, and information to describe consequences Most time, effort, and cost of analysis involves building the model and collecting the data Consequences are uncertain


Ghost Dance Fault: Ghost Dance Fault What is the probability that the Ghost Dance fault is active? What is the definition of active? What is the Ghost Dance Fault?


Implications for Applications: Implications for Applications Unambiguously clarify terms Quantify uncertainties Quantify consequences (or fully and completely describe them) Develop clearly defined measurement scales


“Get the Data First”: “Get the Data First” Usually a bad idea The objectives, alternatives, and tradeoffs indicate what data and information is desired Much of the ‘data’ collected first may turn out to be irrelevant Ex: Auburn Dam Reservoir Induced Seismicity


Tradeoffs: Tradeoffs Minimizing the risk is not the objective Construct an objective function There are multiple objectives and these must be ‘balanced’ using value tradeoffs (i.e. even swaps) Risk tolerance is also relevant Value judgments are required to do this


Tradeoffs - What is More Important: Tradeoffs - What is More Important In cleaning up hazardous waste sites, rank the following in order of importance (1 is most important): ___ Economic costs of the clean-up ___ Human illness caused by the hazard ___ Damage caused to the natural environment (i.e. flora and fauna)


Decisions Based on Values: Decisions Based on Values Most common error: which objective is most important In cleaning up hazardous waste sites, check the alternative that you prefer: ___ Alternative A which costs $1 billion and 20 people nationwide subsequently get very ill for 1 week each. ___ Alternative B which costs $2 billion and 10 people nationwide subsequently get very ill for 1 week each.


Uncertainty: Uncertainty Uncertainty is the lack of complete knowledge of what is or what might occur Probability quantifies uncertainty (coin flip) Because of uncertainty, you won’t know what consequences you will get until after deciding What are some decisions without uncertainties?


Risk Profile: Introduction: Risk Profile: Introduction What are the key uncertainties? What are the possible outcomes of these uncertainties? What are the probabilities of occurrence of each possible outcome? What are the consequences of each outcome?


A Perspective on Analysis: A Perspective on Analysis People make decisions The model is not the real world, so answers for the model are not answers to the problem No analysis ever makes a decision Analysis, done well, can provide insight to make good (or better) decisions Good analysis includes sensitivity analyses Analysis and insights provide a basis for communicating


On Objective Analysis: On Objective Analysis There is no objective analysis The foundation of any analysis is based on subjective judgments Problem Objectives Alternatives Data and Information Sources Foundation is common sense Analysis can be systematic, honest, justifiable, consistent, understandable


Summary Points: Summary Points The problem drives the analysis The objectives and alternatives define the analysis Include all that is important to the problem The standard for what you should do and how you should do it is common sense