Critiques

From PCSAR

(Difference between revisions)
Jump to: navigation, search
(Critique notes)
Current revision (02:33, 5 November 2023) (edit) (undo)
(Sample agenda)
 
(20 intermediate revisions not shown.)
Line 15: Line 15:
The person selected to chair the critique and manage the critique process should
The person selected to chair the critique and manage the critique process should
not have been involved in the incident.
not have been involved in the incident.
-
A critique should not be hindered the blind spots that we each have.
+
A critique should not be hindered by the blind spots that we each have.
If the facilitator is someone that was involved in the incident,
If the facilitator is someone that was involved in the incident,
especially a member of the overhead team or Incident Commander,
especially a member of the overhead team or Incident Commander,
Line 93: Line 93:
as a ''suggestion'' directed to the parts of the organization that would normally handle such ideas.
as a ''suggestion'' directed to the parts of the organization that would normally handle such ideas.
-
Pincher SAR has a number of committees that specialize in areas of governance, budget, standard operating policies, equipment, training and membership.
+
Pincher SAR has a number of committees that specialize in areas of governance, budget, standard operating procedures, call-out, equipment, training and membership.
=== Discuss around functional areas ===
=== Discuss around functional areas ===
Line 119: Line 119:
* Pick a time (Tuesday evening?) when most participants in the search are available.
* Pick a time (Tuesday evening?) when most participants in the search are available.
* book a room ([[Fire Hall]], [[MD Meeting Room]], [[Town Hall Gym]])
* book a room ([[Fire Hall]], [[MD Meeting Room]], [[Town Hall Gym]])
-
* Announce by e-mail or call-out.
+
* {{subpage|Announce}} by e-mail or call out.
-
* Have someone (usually the last Search Manager involved) draft a 1 page summary of the incident. (see [[Incident Summary Form Task]])
+
* Have someone (usually the last Search Manager involved) draft a 1 page summary of the incident. (see [[Template:Incident Report]])
 +
* Review the Incident Report. If you have questions, check the [[Incidents|incident files]].
 +
* Decide which are the most important functional areas to discuss.
* Invite the tasking agency and other organizations we worked with to send a representative. Many SAR groups are listed at: http://www.saralberta.ca
* Invite the tasking agency and other organizations we worked with to send a representative. Many SAR groups are listed at: http://www.saralberta.ca
* Decide whether snacks are needed and arrange them.
* Decide whether snacks are needed and arrange them.
Line 127: Line 129:
=== At the critique ===
=== At the critique ===
 +
Your effort: 1.5 hrs
* Chair the meeting.
* Chair the meeting.
*: Your function is to focus and facilitate the discussion. Let the participants do most of the talking. If you get involved in bringing out your own suggestions or teaching, it's very easy to get distracted from your facilitation role. Perhaps you can add any suggestions you have to the report in the same way as you'll add any suggestions emailed to you by those who could not attend.
*: Your function is to focus and facilitate the discussion. Let the participants do most of the talking. If you get involved in bringing out your own suggestions or teaching, it's very easy to get distracted from your facilitation role. Perhaps you can add any suggestions you have to the report in the same way as you'll add any suggestions emailed to you by those who could not attend.
* Ask someone to take detailed notes. This shouldn't be someone who will be doing a lot of talking during the critique (e.g. a central person in the incident).
* Ask someone to take detailed notes. This shouldn't be someone who will be doing a lot of talking during the critique (e.g. a central person in the incident).
-
* Sample agenda (usually there is not enough time for all of these items; focus on the important ones)
+
==== Sample agenda ====
-
** introductions
+
(usually there is not enough time for all of these items; focus on the important ones)
-
** sign in (to the critique)
+
* introductions
-
** confidentiality
+
* sign in (to the critique)
-
** brief report from person in charge of post op activities (last search manager?) re expenses, lost and found, work needing doing, etc.
+
* note taker
-
** what a critique is
+
* confidentiality
-
*** understanding
+
* brief report from person in charge of post op activities (last search manager?) re expenses, lost and found, work needing doing, etc.
-
*** learning, improvement
+
* what a critique is
-
*** suggestions, ideas
+
** understanding
-
*** how suggestions will be distributed
+
** learning, improvement
-
*** committees that will make decisions on suggestions
+
** suggestions, ideas
-
** incident summary (from draft 1-page report)
+
** how suggestions will be distributed
-
** functional areas of incident (there likely will only be time to cover the most significant)
+
** committees that will make decisions on suggestions
-
**: The ''leading questions'' are just to help the participants think about the subject matter of the functional area. The chair can read them if the participants are stumped about what to say about a functional area. They don't have to be answered.
+
* incident summary (from draft report)
-
*** mandate
+
* functional areas of incident (there likely will only be time to cover the most significant)
-
***: leading questions: Does our team have a mandate to respond to these types of situations? Should it? Are there other organizations that have a mandate to be involved?
+
*: The ''leading questions'' are just to help the participants think about the subject matter of the functional area. The chair can read them if the participants are stumped about what to say about a functional area. They don't have to be asked or answered, if the group is already jumping into discussion about the functional area.
-
*** first notification / tasking
+
** mandate
-
***: leading questions: Was the emergency detected promptly? How was it deteced? Who called who? Was the magnitude of the emergency assessed correctly at the start? What means were used for this assessment? Are any guides or aids needed to assist emergency evaluation? Was our information adequate?
+
**: leading questions: Does our team have a mandate to respond to these types of situations? Should it? Are there other organizations that have a mandate to be involved?
-
*** call-out
+
** first notification / tasking
-
***: leading questions: When was Callout notified? Was it appropriate to mobilize PCSAR resources and was this promptly initiated? How could the response time improve? Was a search manager notified promptly? Were search personnel notified promptly? Were the appropriate type of personnel requested? Were there people that met the criteria that were not called? Was their an appropriate response? Were contact numbers up to date?
+
**: leading questions: Was the emergency detected promptly? How was it detected? Who called who? Was the magnitude of the emergency assessed correctly at the start? What means were used for this assessment? Are any guides or aids needed to assist emergency evaluation? Was our information adequate?
-
*** investigation
+
** call-out
-
***: leading questions: What investigations were happening beyond the search effort? What information was key to shaping the search? What could be done to obtain trustworthy information in a timely manner?
+
**: leading questions: When was Callout notified? Was it appropriate to mobilize PCSAR resources and was this promptly initiated? How could the response time improve? Was a search manager notified promptly? Were search personnel notified promptly? Were the appropriate type of personnel requested? Were there people that met the criteria that were not called? Was there an appropriate response? Were contact numbers up to date?
-
*** communications
+
** investigation
-
***: leading questions: Were communications adequate? What technology was or could have been used? Did messages get passed when they were needed? Was communications clear and accurate?
+
**: leading questions: What investigations were happening beyond the search effort? What information was key to shaping the search? What could be done to obtain trustworthy information in a timely manner?
-
*** (de)briefing
+
** communications
-
***: leading questions: How were teams briefed? Were they provided sufficient background information? Did they understand their assignment and operating procedures? Were teams efficiently debriefed? Did all the information that was needed get recorded?
+
**: leading questions: Were communications adequate? What technology was or could have been used? Did messages get passed when they were needed? Was communications clear and accurate?
-
*** searching
+
** (de)briefing
-
***: leading questions: What was the initial strategy for response to this emergency? What techniques proved effective How did the stategy evolve and change during the emergency and how were thes changes implemented? What problems did seachers encounter? What improvements could be made in searching?
+
**: leading questions: How were teams briefed? Were they provided sufficient background information? Did they understand their assignment and operating procedures? Were teams efficiently debriefed? Did all the information that was needed get recorded?
-
*** access/return from segment
+
** searching
-
***: leading questions: How was access to/from the search segments?
+
**: leading questions: What was the initial strategy for response to this emergency? What techniques proved effective? How did the stategy evolve and change during the emergency and how were these changes implemented? What problems did searchers encounter? What improvements could be made in searching?
-
*** extrication
+
** access/return from segment
-
***: leading questions: How was the subject extricated? What would have made it more complicated? Was the team prepared for the possible situations?
+
**: leading questions: How was access to/from the search segments?
-
*** stand down
+
** extrication
-
***: leading questions: When was the decision made to stand down? Were there problems demobolizing?
+
**: leading questions: How was the subject extricated? What would have made it more complicated? Was the team prepared for the possible situations?
-
*** CISM
+
** stand down
-
***: leading questions: What were/could have been the critical stresses on this incident? What support was available/used?
+
**: leading questions: When was the decision made to stand down? Were there problems demobolizing?
-
*** prevention, public education
+
** CISM
-
***: leading questions: How could this incident have been prevented? Was this incident used to educated the public?
+
**: leading questions: What were/could have been the critical stresses on this incident? What support was available/used?
-
*** travel
+
** prevention, public education
-
***: leading questions: How did responders get to and from the site? Were convoy's used? Was there a need for people to check in when they returned? Was travel safety evaluated?
+
**: leading questions: How could this incident have been prevented? Was this incident used to educated the public?
-
*** Plans Section
+
** travel
-
***: leading questions: What preplans were in place to help with this incident? Were maps, situation reports, weather and hazard forecasts provided to all who needed them? Was the selection of team assignments guided by analysis of the situation? Was the plan for the next op period ready before it started? Were clues, PODs, map updates and recommendations from the field being used to focus search efforts and provide updated information to teams going to the field?
+
**: leading questions: How did responders get to and from their home/station to the site? Were convoys used? Was there a need for people to check in when they returned? Was travel safety evaluated?
-
*** Logistics Section
+
** Plans Section
-
***: leading questions: What teams/personnel/equipment/materiel was mobilized? How were they mobilized? How did utilization change with time? Were resources used effectively? Were they easy to obtain? Do we have adequate knowledge of resource availability? Are there other resources in our team that we didn't know we had?
+
**: leading questions: What preplans were in place to help with this incident? Were maps, situation reports, weather and hazard forecasts provided to all who needed them? Was the selection of team assignments guided by analysis of the situation? Was the plan for the next op period ready before it started? Were clues, PODs, map updates and recommendations from the field being used to focus search efforts and provide updated information to teams going to the field?
-
*** media
+
** Logistics Section
-
***: leading questions: How was the media handled? What problems were encountered?
+
**: leading questions: What teams/personnel/equipment/materiel was mobilized? How were they mobilized? How did utilization change with time? Were resources used effectively? Were they easy to obtain? Do we have adequate knowledge of resource availability? Are there other resources in our team that we didn't know we had?
-
*** family
+
** safety
-
***: leading questions: What support did the family need? What critical information came from the family? Was the family kept informed? Did we use other teams to link with family in other communities?
+
**: leading questions: Who performed the functions of the Safety Officer? How were safety concerns identified? What safety issues arose? What near misses were there? How were safety issues addressed? How was it verified that individuals had the skills, physical and mental comfort for what they were asked to do?
-
*** post ops
+
** media
-
***: leading questions: What were the major post op activities? When was the team fully ready to be deployed again? Was this work left to only a few volunteers?
+
**: leading questions: How was the media handled? What problems were encountered?
-
*** learning
+
** family
-
***: leading questions: How has/could the critique support learning? For exercises, how did/could the goals/techniques promote learning?
+
**: leading questions: What support did the family need? What critical information came from the family? Was the family kept informed? Did we use other teams to link with family in other communities?
-
*** miscellaneous
+
** post ops
-
***: leading questions: Are there any subject areas we haven't touched on?
+
**: leading questions: What were the major post op activities? When was the team fully ready to be deployed again? Was this work left to only a few volunteers?
-
** round table (anyone have points that they need to bring up that wasn't already mentioned)
+
** learning
-
Your effort: 1.5 hrs
+
**: leading questions: How could this critique have been made a stronger learning opportunity? For exercises, how did/could the goals/techniques promote learning?
 +
** miscellaneous
 +
**: leading questions: Are there any subject areas we haven't touched on?
 +
* round table (anyone have points that they need to bring up that wasn't already mentioned)
=== After the critique ===
=== After the critique ===
Line 192: Line 198:
** Sort and write up the suggestions (we have examples of this). See [[PCSAR DOC-97 Critique form|PCSAR Doc-97]]
** Sort and write up the suggestions (we have examples of this). See [[PCSAR DOC-97 Critique form|PCSAR Doc-97]]
** Assign suggestions to be reviewed by PC SAR board, PC SAR preplan committee, PC SAR equipment committee, PC SAR call out committee, PC SAR training committee or one of our partner organizations.
** Assign suggestions to be reviewed by PC SAR board, PC SAR preplan committee, PC SAR equipment committee, PC SAR call out committee, PC SAR training committee or one of our partner organizations.
-
* Forward your report to each group.
+
* place the critique suggestions on the wiki under the "Critique" subpage of the [[Incident]].
 +
* {{subpage|Email Report|Forward your report to each group.}}
* Send the sign-in list from the critique to the Membership Coordinator.
* Send the sign-in list from the critique to the Membership Coordinator.
 +
* Update this page on the wiki to make it easier and better to run another critique.
Your effort: 2.5 hrs.
Your effort: 2.5 hrs.

Current revision

Critiques are one of the most effective ways Pincher SAR has to improve the manner in which it works. The purpose of a critique is not to be critical but to share an understanding of what worked well and what could be improved. By building on this shared understanding, Pincher SAR can continuously improve its responses.

Pincher SAR performs a critique after all but minor incidents.

Contents

[edit] Principles

In order to have an effective critique, we try to adhere to these principles.

[edit] Neutral knowledgeable facilitator

The person selected to chair the critique and manage the critique process should not have been involved in the incident. A critique should not be hindered by the blind spots that we each have. If the facilitator is someone that was involved in the incident, especially a member of the overhead team or Incident Commander, there's a risk that if one of their personal blind spots affected the incident, they will still be blind to it and not see it as needing discussion.

The facilitator should be a knowledgeable person. He or she should understand the subject matter (in our case SAR). This usually means someone with Search Management training. A knowledgeable chair can understand the points being raised and not slow down or misdirect the conversation.

[edit] Invite all stakeholders

A critique should take a look at all aspects of the incident. It is an opportunity for all players to brainstorm together to understand ways of improving.

As such, all people that have a stake in the incident should be invited. This typically means Pincher SAR invites the other SAR groups that participated along with the police and other government agencies. We invite everyone who participated, regardless of their role in the incident. (E.g. field searchers, call-out personnel, overhead team members, spontaneous searchers, the subject, and family).

Attending a critique is a valuable learning experience even if you couldn't respond to the incident. We invite all of our members to attend all critiques.

Sometimes we have to limit the number of participants to an effective maximum size of 20 to 30. If we think the numbers are too large, we would selectively invite representatives from all stakeholders and supply an alternative means of input for the others.

There will always be some people that cannot attend the critique. They should be invited to submit their feedback directly to the facilitator.

[edit] Respect confidentiality

Searches are usually done on behalf of the police and often there will be requirements to keep some or much of the information confidential. These requirements should be reiterated before entering into the discussions.

[edit] Facts first

Before getting into discussions, all the participants should know the facts. This allows all the participants to discuss ideas with a clearer understanding of the situation.

A written summary of the incident should be prepared prior to the critique. This is typically drafted by the last Incident Commander. If there is time, it should be circulated prior to meeting and additions and feedback incorporated.

At the critique the written summary should be read, or if one has not been completed then a verbal report can be given. Any corrections should be taken and the summary updated.

[edit] Focus on learnings

A critique is not about criticism. It should not become a forum for blame or guilt.

Instead a critique should be about learning. All participants should agree to focus on bringing out ideas that will help improve the response to future incidents.

Learnings can come from things that didn't work well and ideas on how to change them. But it's just as important to bring up learnings from things that worked well and should be repeated or further developed.

[edit] Ideas, not decisions

The critique is a brainstorming session. Many of the ideas that are brought up during the critique will take some serious thought before they are implemented. We don't want the meeting to get bogged down in debate. So the focus should be on capturing the idea and not on deciding whether or not to implement it. Sometimes the decision will be obvious, but most often it's better to leave the idea as a suggestion directed to the parts of the organization that would normally handle such ideas.

Pincher SAR has a number of committees that specialize in areas of governance, budget, standard operating procedures, call-out, equipment, training and membership.

[edit] Discuss around functional areas

After an incident of any size there is a lot to discuss. If every person brings up every point they can think of, the meeting will be so long that everyone would be exhausted.

To bring out the most relevant points and focus discussion, the chair should walk the meeting through the functional areas of the incident one by one. E.g. Call-Out, Search Techniques, Demobilization. There is a list of possible functional areas in the sample agenda below. Usually there won't be enough time to discuss all functional areas so the facilitator should select the ones that are likely to be most relevant.

[edit] Round table

After the functional areas have been discussed, enough time should be left near the end of the meeting for a round table. This allows any important idea that hasn't been raised to be brought out. Often it's here that you'll hear from those who have otherwise been very quiet through out the meeting.

[edit] Tasks

[edit] Leading up to the critique

  • Prepare for the meeting
  • Pick a time (Tuesday evening?) when most participants in the search are available.
  • book a room (Fire Hall, MD Meeting Room, Town Hall Gym)
  • Announce by e-mail or call out.
  • Have someone (usually the last Search Manager involved) draft a 1 page summary of the incident. (see Template:Incident Report)
  • Review the Incident Report. If you have questions, check the incident files.
  • Decide which are the most important functional areas to discuss.
  • Invite the tasking agency and other organizations we worked with to send a representative. Many SAR groups are listed at: http://www.saralberta.ca
  • Decide whether snacks are needed and arrange them.
  • Collect suggestions from those members that can't attend.

Your effort: 1 hr

[edit] At the critique

Your effort: 1.5 hrs

  • Chair the meeting.
    Your function is to focus and facilitate the discussion. Let the participants do most of the talking. If you get involved in bringing out your own suggestions or teaching, it's very easy to get distracted from your facilitation role. Perhaps you can add any suggestions you have to the report in the same way as you'll add any suggestions emailed to you by those who could not attend.
  • Ask someone to take detailed notes. This shouldn't be someone who will be doing a lot of talking during the critique (e.g. a central person in the incident).

[edit] Sample agenda

(usually there is not enough time for all of these items; focus on the important ones)

  • introductions
  • sign in (to the critique)
  • note taker
  • confidentiality
  • brief report from person in charge of post op activities (last search manager?) re expenses, lost and found, work needing doing, etc.
  • what a critique is
    • understanding
    • learning, improvement
    • suggestions, ideas
    • how suggestions will be distributed
    • committees that will make decisions on suggestions
  • incident summary (from draft report)
  • functional areas of incident (there likely will only be time to cover the most significant)
    The leading questions are just to help the participants think about the subject matter of the functional area. The chair can read them if the participants are stumped about what to say about a functional area. They don't have to be asked or answered, if the group is already jumping into discussion about the functional area.
    • mandate
      leading questions: Does our team have a mandate to respond to these types of situations? Should it? Are there other organizations that have a mandate to be involved?
    • first notification / tasking
      leading questions: Was the emergency detected promptly? How was it detected? Who called who? Was the magnitude of the emergency assessed correctly at the start? What means were used for this assessment? Are any guides or aids needed to assist emergency evaluation? Was our information adequate?
    • call-out
      leading questions: When was Callout notified? Was it appropriate to mobilize PCSAR resources and was this promptly initiated? How could the response time improve? Was a search manager notified promptly? Were search personnel notified promptly? Were the appropriate type of personnel requested? Were there people that met the criteria that were not called? Was there an appropriate response? Were contact numbers up to date?
    • investigation
      leading questions: What investigations were happening beyond the search effort? What information was key to shaping the search? What could be done to obtain trustworthy information in a timely manner?
    • communications
      leading questions: Were communications adequate? What technology was or could have been used? Did messages get passed when they were needed? Was communications clear and accurate?
    • (de)briefing
      leading questions: How were teams briefed? Were they provided sufficient background information? Did they understand their assignment and operating procedures? Were teams efficiently debriefed? Did all the information that was needed get recorded?
    • searching
      leading questions: What was the initial strategy for response to this emergency? What techniques proved effective? How did the stategy evolve and change during the emergency and how were these changes implemented? What problems did searchers encounter? What improvements could be made in searching?
    • access/return from segment
      leading questions: How was access to/from the search segments?
    • extrication
      leading questions: How was the subject extricated? What would have made it more complicated? Was the team prepared for the possible situations?
    • stand down
      leading questions: When was the decision made to stand down? Were there problems demobolizing?
    • CISM
      leading questions: What were/could have been the critical stresses on this incident? What support was available/used?
    • prevention, public education
      leading questions: How could this incident have been prevented? Was this incident used to educated the public?
    • travel
      leading questions: How did responders get to and from their home/station to the site? Were convoys used? Was there a need for people to check in when they returned? Was travel safety evaluated?
    • Plans Section
      leading questions: What preplans were in place to help with this incident? Were maps, situation reports, weather and hazard forecasts provided to all who needed them? Was the selection of team assignments guided by analysis of the situation? Was the plan for the next op period ready before it started? Were clues, PODs, map updates and recommendations from the field being used to focus search efforts and provide updated information to teams going to the field?
    • Logistics Section
      leading questions: What teams/personnel/equipment/materiel was mobilized? How were they mobilized? How did utilization change with time? Were resources used effectively? Were they easy to obtain? Do we have adequate knowledge of resource availability? Are there other resources in our team that we didn't know we had?
    • safety
      leading questions: Who performed the functions of the Safety Officer? How were safety concerns identified? What safety issues arose? What near misses were there? How were safety issues addressed? How was it verified that individuals had the skills, physical and mental comfort for what they were asked to do?
    • media
      leading questions: How was the media handled? What problems were encountered?
    • family
      leading questions: What support did the family need? What critical information came from the family? Was the family kept informed? Did we use other teams to link with family in other communities?
    • post ops
      leading questions: What were the major post op activities? When was the team fully ready to be deployed again? Was this work left to only a few volunteers?
    • learning
      leading questions: How could this critique have been made a stronger learning opportunity? For exercises, how did/could the goals/techniques promote learning?
    • miscellaneous
      leading questions: Are there any subject areas we haven't touched on?
  • round table (anyone have points that they need to bring up that wasn't already mentioned)

[edit] After the critique

  • Report
    • Edit the incident summary to include information that came out in the critique.
    • Sort and write up the suggestions (we have examples of this). See PCSAR Doc-97
    • Assign suggestions to be reviewed by PC SAR board, PC SAR preplan committee, PC SAR equipment committee, PC SAR call out committee, PC SAR training committee or one of our partner organizations.
  • place the critique suggestions on the wiki under the "Critique" subpage of the Incident.
  • Forward your report to each group.
  • Send the sign-in list from the critique to the Membership Coordinator.
  • Update this page on the wiki to make it easier and better to run another critique.

Your effort: 2.5 hrs.

[edit] Critique notes

[edit] See also

Personal tools