Showing posts with label PMI-ACP Exam Tips. Show all posts
Showing posts with label PMI-ACP Exam Tips. Show all posts

Thursday, May 04, 2023

ACP Success Story: If You Have Prepared Well for Your PMP Exam, The ACP Exam Will Be A Cakewalk

 By Sandip Kumar Nath, ACP, PMP


Introduction
During my PMP certification preparation, I have already done a good amount of study in Agile concepts. So, I was already in a mindset to get an Agile certification. I’ve been a certified PMP since June, 2021.

Before taking any decision, I had reached out to my mentor, Satya Sir and shared my thoughts.  His first advice to me was to take a break, enjoy the moment of my PMP success, and then go for PMI-ACP. He also informed me that other Agile certificates will explain only about a specific Agile methodology whereas ACP will help me to understand Agile concept as a whole. 

So, I have set my mind to go for PMI-ACP certification to understand Agile deeper and better.

ACP 21 Contact Hours
Every action item should have an owner and estimated time (ETA) associated with it. After completing my 21-hour training, the first thing I did was to fill the ACP exam form and submit.

A week later my application was approved and on the same day I paid the exam fee and scheduled a target date. I targeted for exactly 12 weeks.  

Now my actual preparation has started.

Resources Used
You can use any material you feel comfortable and available to you. But refer to the Agile Practice guide read at least once. This book is very basic and doesn't elaborate much on agile specific methods but gives good clarity on the differences between Traditional Project Management and Agile Project Management.

My primary resources were these: 

As I am a PMP, it helped me a lot in my preparation for the ACP exam. I have again gone back and studied the book, I Want to be a PMP by Satya Sir, but this time I have read only the topics which were relevant for Agile concepts.

As mentioned earlier, I passed PMP on 19th June 2021. And I felt 70% of the questions asked in the PMP exam were based on agile concepts. My personal experience in PMI-ACP was, if you have prepared really well for your PMP exam, your ACP exam will be a cakewalk. I was mentally prepared that I will not get any direct questions and the same happened in the real exam.

You can read my PMP Success Story here:
PMP Success Story: Focus, Consistent Practice and Self-Belief Will Make You A PMP

Own Study
I had a simple plan and as per this plan, I wanted to put around 400 to 450 hours of study. It includes the Books, Blogs, Articles, available Questions and Answers. There were enough. So, I had planned for 4-5 hours per day for the next 12 weeks.

In addition, I followed this free course from scrum alliance.
Name of the course: Introduction to Scrum (https://scrumalliance.learnupon.com/store/804338-introduction-to-scrum) and PM Prepcast Simulator

My preparation was smooth and I faced no difficulty in preparing or submitting the application form.  

ACP Exam Experience
My exam was scheduled center based on 10th March 2023 but Pearson canceled it. So, I again booked the slot in Pearson Shivaji Nagar Branch, Bangalore on 19th April 2023, 8am.

I had taken my PMP exam from home but this time I have decided to take my ACP exam from Pearson. Though I did not face difficulties by taking the exam from home last time, I still encourage you all to go to the center and give the exam.

Both taking the ACP exam from home and center have their pros and cons. For example, while taking the exam from home: 

  • You have your own known and comfortable environment; at the same time, you must make sure that you have a reliable internet connection.
  • Ensure to find a quiet place so that you can concentrate on the exam.

If you are taking the ACP exam from center:

  • Please do not carry anything except a valid ID (Aadhar ID is not accepted).

I reached around 7:20am to the center and after all formality I hope I have started my exam around 8 am.

 
ACP Exam Taking Strategy

I followed the below ones while taking the exam.

  • My first and foremost strategy was to make myself as calm as possible. 
  • I was mentally prepared that this exam will NOT be easy with a positive note that I WILL PASS.
  • I always read the question first so that I will NOT miss key words like NOT, LEAST, MOST, EXCEPT, ALL, ALWAYS, NEVER etc. This is crucial, otherwise I will choose the wrong answer. 
  • Then I read the scenario or the problem statement to understand which context the question was asked. 
  • Final step to read all given answers choices and choose the correct option(s). 
  • Time management was a big factor.  My plan was to take 60 min per 40 questions.

Type of Questions Faced in the ACP Exam
Below is my experience with the types of questions faced. 

  • I had NO direct questions, NO key words. All questions were scenario-based.
  • Around 80% of questions were one or two liners. Very few questions had three to four sentences or more. 
  • I faced NO mathematical questions. Hence, I did not use calculator.
  • For your exam, you need to be very clear about roles/responsibilities of Stakeholders (Internal and External).
  • Many ACP exam questions were from Agile events, Stakeholders, Agile Team. These will be related to ACP Exam Domains.

During the exam, there will be some interruptions due to candidate movements and mouse click sounds! But I used the headset given me which helped a lot. This you can’t use at home if you opt to take an exam from home.   

In addition, as per exam rule you have to report 30 minutes before your scheduled time. So, it is always better if you reach a little early.

Suggestions for ACP Aspirants
Dos

  • Fix the exam date ASAP. Until you do not have the exam date, you will NOT be able to plan and execute your preparation.
  • Focus is the key. Focus on your study plan, focus on the topic you are studying now, focus while answering questions. 
  • Try to understand each topic you read and make your own notes while reading. 
  • During the exam usually, you can eliminate two answers easily but if you have difficulty in choosing between two, re-read the QUESTION first.
  • If the above step is not working for you, re-read the problem statement which has a lot of distractions and unnecessary information, considering the real question.

Don’ts 

  • During the exam, never think about the previous question(s) you already answered or the performance of your previous section. 
  • Avoid brain dump if possible. Please do not take unnecessary tension before the exam and brain dump will NOT help you in the exam.

Conclusion
It's a pleasure and privilege to write my experience and share with you readers. I believe, it will help you in your endeavor to be a PMI-ACP.

Wish you all the best for your ACP exam.

Brief Profile: Sandip Kumar Nath, PMP, ACP
Senior Manager – Delivery, Datamatics.
 



ACP Live Lessons - Guaranteed Pass:

ACP 21 Contact Hours Course:



Sunday, May 08, 2022

Earned Value Management (EVM) in Agile Development


In this article, we are going to explore Earned Value Management (EVM), a widely used traditional management technique, but we are going to look at it within the context of an Agile domain.

Let’s consider an example scenario. A product manager, who works for a large aircraft manufacturing organization in the United States, follows a hybrid model of development and, with his team, releases a new version of aircraft handling software every couple of weeks. At the start of each iteration, he may be unsure about the applicability of earned value analysis, measurement, and management within Agile. His main questions may be:

  • How can we apply EVM while following an Agile approach? Is it natural?
  • With frequent scope changes, how does one determine what to measure against?
  • Scope change is also frequent on the iteration level! How can we incorporate EVM metrics in such cases?

To understand EVM, one needs to understand the concept of baseline, first and foremost. In EVM terminology, baseline is further defined as the performance measurement baseline (PMB). Let’s first define PMB, because, as I’ve seen, the lack of clarity regarding EVM is typically due to lack of PMB understanding. 

Performance Measurement Baseline (PMB)

The PMB is a virtual (not physical) baseline integrating scope, schedule, and cost baselines. In other words, PMB is the time-phased budget of authorized work for a project or program.

EVM is fundamentally based on this baseline–irrespective of chosen life cycle, be it predictive (Traditional), adaptive (Agile), or any other. It doesn’t matter how many iterations (or sprints, if in Scrum) you have or how frequently the scope changes. For EVM, it matters where and how you are setting your baseline. We will see shortly where the baseline is an Agile context. As EVM integrates scope, schedule, and cost, it’s quite a powerful technique. This is shown in the below figure.

 

Another issue occurs when management practitioners incorrectly interpret earned value as being business value. Earned value is not business value, rather it’s the value that you have earned in terms of money after completing the work. Hence, it’s actually a measure of work performance or performance against the set baseline or PMB.

With these fundamentals in mind, let’s now consider the foundational metrics in EVM. 

Foundational Metrics in EVM

The foundational metrics in traditional EVM are noted in the below table. I call them the foundational (or basic) metrics, because, based on these metrics, current and future performance metrics are derived.

As you go through the metrics in EVM, one key thing is to remember is this: everything is in terms of money. The budget, of course, will be in terms of money, and the work planned and work performed or executed, will also be in terms of money in this case.


We will look at the usage of these foundational metrics for Agile development shortly. Note that with these foundational metrics in place, we derive performance metrics of EVM.  

Current Performance Metrics in EVM

The current performance metrics used to calculate EVM are noted in the below table for a Traditional environment. I call these metrics current performance metrics, because the measurement happens on the status date, data date, or record date. The good news is, that these foundational metrics remain the same for Agile projects and/or programs.  Keep reading, as we are going to reuse these performance metrics in the next section.

It’s pertinent to note the behavior of SV and CV. If they are positive or negative, then the project or program is ahead of or behind schedule and cost, respectively. Similarly, if SPI and CPI are above or below 1.0, then the project or program is ahead of or behind schedule and cost, respectively. 

Using EVM in Agile Approaches

When using EVM in an Agile approach or environment, we circle back to the concept of baseline. In Agile projects, the baseline at the release level, not at an iteration level must be considered.

You may be wondering why. In Agile approaches, work is considered “done” at the end of each iteration (or sprint). While it’s true that story points are used to relatively estimate work items being taken-up, work is not considered to be fully “done” until the end of the iteration. If an item is not done, then it’s usually pushed into the next iteration. Hence, measurement during an iteration adds no value. This is because the work can’t be complete/done (or incomplete/not-done) mid- iteration.

If a story is complete, only then is it considered “done.” If a story is partially complete, (say only transition testing is remaining, then it’s not considered to be “done” at all). As you can see, it’s futile to have a baseline at an iteration level.

Are you wondering now how to calculate the performance measurement baseline (PMB) at a release level?

Simply add up the number of story points that you have planned for the release. While the PMB is at the level of the release, we do the measurement at the end of every iteration. In other words, our status date or data date is set for the end of the iteration. This is because, at the end of the iteration, we know the amount of work completed or “done.” And, this work counts towards velocity. Velocity, as explained in this article, also can inform the number of iterations in a release. You can decide to have measurement at the end of any iteration – iteration 1, iteration 2, and/or iteration-N.

A (product) backlog-based representation with earned value related calculations is depicted in the figure below.


As shown, the EV, PV, and AC values are calculated on the status/data date, which occurs at the completion of the iteration. The PMB is set for the release, and this also informs the budget at completion (BAC) for the release.

Next, we will consider the metrics associated with EVM in an Agile environment. 

EVM Metrics in Agile Approaches

The foundational EVM metrics used in Agile are noted in the below table with explanations. As you can see, the traditional metrics of EV, PV, AC, and BAC are also taken-up in Agile development; however, the explanation and understanding with respect to Agile contexts are different.


The values for PV, EV, and AC are calculated at the end of every iteration (you can set the status date as of the end of the concerned or considered iteration), whereas the BAC is determined at the release level. This is in sync with the backlog-based representation that we saw earlier.

The budget at completion (BAC) at the release level will be calculated as follows:

Budget at Completion (BAC)

= Total budget for the release

= Number of Items in the Release * Cost per backlog items (or cost per PBI)

For every item in the backlog (PBIs), cost is usually considered, which is one of the key product prioritization factors.

Now that we have the BAC, we can easily calculate the EV and PV, respectively with the below formulas:

First taking PV, the formula will be:

Planned Value (PV)

= Percentage of planned complete * BAC

= % of planned complete * BAC.

Earlier I said, PV, EV, and AC, etc. are calculated as of the status/data date or the iteration completion date. Considering an scenario where you have five iterations in a release and you are measuring at the end of the 2nd iteration, we’d see the following: case:

Percentage (%) of planned complete

= Iteration number / Number of iterations

= 2/5

= 40%

The formula for earned value (EV) will come out as shown below.

Earned Value (EV)

= Percentage of actual complete * BAC

= % of actual complete * BAC.

Why are we considering percentage of percentage of actual complete for EV? It’s because earned value is the value that you have earned by completing the work or having “done” the work.

To determine the percentage of actual completed work, you have to consider the stories that have been completed at the end of an iteration. Let’s say you have completed 40 story points worth of work out of 200 in a release, and you’re at the end of 2nd iteration. The percentage is calculated as follows:

Percentage (%) of actual complete

= Story points completed (or done) / Total story points

= 40/200

= 20%

I’ve summarized the calculations in the below table. 

So far, we have shown small examples with respect to BAC, PV, EV, and AC. Based on these metrics, we can easily calculate the current performance metrics of SV, CV, SPI, and CPI using the formulas mentioned in Table – 2.

For this purpose, let’s take an example from the course, ACP Live Lessons, Guaranteed Pass, to compute the associated metrics. A dedicated set of videos are available in the Live Lessons course.

An Example – EVM In Agile

A project is being released in an Agile mode. Below are the details for the project:

  • Product Backlog = 500 story points
  • In the first release = 200 story points
  • Velocity = 25 points per iteration
  • Cost per point = $1600
  • At the end of 1st iteration, actual cost incurred was $30,000.
  • At the end of 1st iteration, story points completed were 20 story points.

With this, we can determine the following.

  • Budget at Completion (BAC)
  • Number of Iterations
  • Planned value per iteration (PV) and Earned Value (EV) for the first iteration
  • Schedule Variance (SV) and Cost Variance (CV)
  • Schedule Performance Index (SPI) and Cost Performance Index (CPI)

If you have understood so far, you can try it on your own and determine the values being asked in the above questions.

To confirm your understanding and reaffirm your answer, the solution is noted below.

Budget at Completion (BAC)

= Cost per point * Number of story points

= $1600 * 200

= $320,000

Total number of Iterations

= Story points in a release / Velocity

= 200 / 25

= 8

Percentage (%) of planned complete at the end of first iteration

= Iteration number / Total number of iterations 

= 1 / 8

= 12.5%

Percentage (%) of actual complete at the end of first iteration

= Total number of story points completed / Total number story points planned

= 20 / 200

= 10%

Now that we have the needed values, let’s calculate the other associated metrics of PV, EV, and AC.

Planned Value (PV) for the iteration

= % of planned complete * BAC

= 12.5% * $320,000

= $40,000

Earned Value (EV) for the iteration

= % of actual complete * BAC  

= 10% * $320,000

= $32,000

The actual cost (AC), as mentioned in the question

= $30,000.

With these calculations, we can now determine the current performance metrics of the project at the end of the first iteration.

Schedule Variance (SV)

= EV – PV

= $32,000 – $40,000

= – $8,000

Cost Variance (CV)

= EV – AC

= $32,000 – $30,000

= + $2,000

Look at Table – 2. One could say the release is behind schedule and under budget by looking at the performance metrics of SV and CV, respectively. This is because SV is negative (bad), whereas CV is positive (good).

Next, let’s determine the values for SPI and CPI.

Schedule Performance Index (SPI)

= EV / PV

= $32,000 / $40,000

= 0.8 

Cost Performance Index (CPI)

= EV / AC

= $32,000 / $30,000

= 1.07

Again, referring to Table – 2, you could say the release is behind schedule and under budget by looking at the performance metrics of SPI and CPI, respectively. This is because SPI is below one (bad), whereas CPI is above one (good). 

Representation in S-Curve

Like a traditional EVM, in Agile context, you can also depict the various EVM metrics in an S-curve. These curves are frequently used in many projects to depict the progress and status reporting. However, your perspective has to change/adapt for the Agile context.

An S-curve showing BAC, EV, PV, AC, SV, and CV is shown in the below figure. 

The BAC is at the release level. The PMB line is along the EV curve. Our status date or data date is at the completion of Iteration – 3, and, on this date, we are measuring the foundational metrics of PV, EV and AC, as well as the current performance metrics of SV, SV, and hence, associated SPI and CPI. When you combine this representation with estimated story points in the product backlog, you can have the release burn-up chart. 

Video – EVM in Agile

As we close, I want to summarize the foundations of EVM in Agile in the below video, taken from the course, ACP Live Lessons [duration: 13m:06s]. This video notes certain key points you should keep in mind when calculating earned value in an Agile domain. It also further explains the above S-curve. For the best experience, you may want to go full-screen in HD mode and plug-in your earphones.


With this, I believe, I leave you with the fundamentals of earned value management executed in Agile environments.

If you have comments, suggestions, or new ideas, please do share them below.

--

This article was first published by MPUG.com on 22nd September, 2020. This is a refined version.


References

[1] Course: ACP Live Lessons, Guaranteed Pass or Your Money Back, by Satya Narayan Dash

[2] Book: I Want To Be A PMI-ACP: The Plain and Simple Way, 2nd Edition, by Satya Narayan Dash

[3] Course: ACP 21 Contact Hours, with Money Back Guarantee, by Satya Narayan Dash



Monday, January 17, 2022

ACP Live Lessons Success Story: ACP Live Lessons is the Best Way to Earn Your PMI-ACP Credential

 By Sindhu Pillai, PMI-ACP, PMP



Introduction

One year ago, I attended an interview and the interviewer asked me a large number of questions on Agile methodologies. I couldn’t even answer a single question properly. 

I took it very personally and felt very offended by it. I made up my mind to master this topic and decided to earn the PMI-ACP credential. 

At the end of my journey, I’ve not only earned the ACP certification, but also understand the Agile mindset and I want to pursue this understanding in my career path.


ACP 21 Contact Hours Experience

I bought Satya's PMI-ACP Book and PMI-ACP Live Video Lessons because I believe in the guarantee he claims. Both the video course and the book have helped me crack the ACP exam. In fact, I was sure that I would crack the ACP exam with Satya’s help. 

After going through all domains, I wrote a test conducted by Satya (as a part of ACP Live Lessons, FAQs). After completing the test, I received the needed 21 contract hours to fill the ACP exam application form.

Own Study

I first bought Satya’s course material (bought both the book and video course) to kick-start my preparation. However, I couldn’t stick to a regular routine of keeping in touch with the course as my official workload increased. I also had a few family emergencies because of which I had a gap in my studies and was finding it very difficult to get back on track. 

When I took PMP training from Satya, I remember his words: “Everyone is enjoying their weekends. But you are sitting here and attending classes. MAKE IT COUNT”.  I kept telling myself, “make it count Sindhu for the weekends and hours you have already put in by sacrificing all the weekend time.” 

I did put my heart and soul into preparation and went hard during December 2021, when the workload reduced. In this month and previous one, I could invest up to 8 hrs a day in preparation. 

Preparation and practice of questions will be the keys and there is no shortcut to success! I’ve gone through Satya’s Live Lessons course a couple of times till my concepts were clear. Simultaneously, I made my notes, which I could refer to whenever needed. And I did a lot of Mock Questions, which were provided by him. 

I did have my ups and downs during the preparation. Satya was always available to help me with all queries and guide me through any obstacle I came across.

Review – PMI-ACP Live Lessons

The ACP Live Lessons course comes with a money back guarantee with no conditions applied, except you appearing in the exam. I was very certain that this course is a complete package to earn this certification. Also, I’ve already used Satya’s PMP Live Lessons, which helped me to clear the PMP exam. Hence, I didn’t have any second thoughts before getting the Live lessons and the I Want To Be An ACP book from Satya. 

The ACP Live Lesson course covers every possible aspect of Agile and associated concepts. Satya has created short and long videos and broken down the lessons in such a way that it makes our life easier. At certain points Satya asks a few questions which act like revisions automatically. There are a set of Smart Card questions after every domain which ensures you have the fundamentals in place. 

After every domain there are a good number of mock questions provided. This helps you to gauge your understanding with respect to the specific domain. Once you are done preparing with all the domains, there are lessons available with video exercises which gauges your overall understanding of this course. 

I found this course very helpful in understanding the Agile principles, values, methodologies in a very insightful way.

After you are done with all the domains and practice tests provided at the end of the individual lessons, there are six full-length questions sets provided in this course. These question sets get tougher with each set. 

These question sets will train to face the exam questions where you get 180 minutes to appear 120 questions. My score was consistently above 95 to 100. Satya informed me these scores are good.

Finally, in my ACP exam, I was able to score Above Target in five domains and Target in two domains. This I did in a few months after the knowledge I gained using this course material and by doing 6 full length questions provided by Satya.

ACP Exam Experience

I booked a centre close to my house to avoid longer travel in traffic. I visited the exam centre a day prior to the exam and enquired about the documents required on the day of exam. The full-length mock questions had given me a feel of the actual exam. The more seriously you take it, the easier it will be for you in the exam.

Following are highlights from my ACP Exam:

  • In the ACP exam I faced a lot of questions on Scrum, Retrospectives, Kanban and Velocity. 
  • There are not many mathematical questions. I had faced one on Velocity.
  • The exam follows the domain distribution closely. The better prepared you are, the higher chances of you clearing the exam.
  • During the exam, keep a tab on timing and ensure you don’t spend much time on a single question. There is an option to flag the question which can be reviewed later. 
  • There is an inbuilt calculator on the screen. Hence, you don’t have to carry a calculator.

Suggestions for ACP Aspirants

Dos: 

  • Always stay focused and always stay in touch with the course during preparation. 
  • Do a lot of practice questions and revisit the areas where you go wrong.
  • Pay special attention to topics where Satya says: it’s important. 
  • I did prepare thoroughly on Scrum, Kanban, Velocity, Charts, XP, Retrospective and I did get a lot of questions in my exam related to them.
  • I’ve always visualized myself clearing the exam and returning home with a pack of sweets and that did happen, so it’s important to stay positive.

Don’ts:

  • You should always remember that by failing to prepare you are preparing to fail!! Hence, leave no stones unturned when you prepare. Success will follow you.

Conclusion

Sindhu Pillai, PMP, PMI-ACP

I’m currently working as a Project Manager in Kyndryl (previously IBM). Now I would like to work in an Agile Environment and use the knowledge & skills earned with this course and the ACP credential.


More on ACP Live Lessons - Guaranteed Pass:

ACP 21 Contact Hours Course:

Saturday, November 20, 2021

Retrospectives and Intraspectives for Agile Practitioners


Two woodcutters were assigned to chop wood in a forest. Both formed a team and started early and earnestly. Although working a distance from each other, they felt the competition to produce the best results.

On that first day, the first woodcutter heard his counterpart stop cutting before the day was really finished. He was surprised, but continued none-the-less. In the next few days, a similar thing happened. A couple of weeks passed. The first woodcutter paid a visit to the second one, confidently thinking that he has cut more wood since he had been working such full, long days. He was taken aback seeing that his counterpart has almost completed twice as much work. He asked, “How is that possible? I never stopped or took a rest, whereas you stopped many times!” The second woodcutter replied, “Yes, but I didn’t actually stop. Rather, I sharpened my axe, so that I could continue cutting better for the next day, the next week, and the weeks ahead.”

Perhaps many of us know this story of the two woodcutters and the key takeaway: “sharpen the axe once in a while and you get better results.” Stephen R. Covey slightly reworded the moral of the story eloquently in his book “The 7 Habits of Highly Effective People” by saying, “Sharpen the saw.

Let’s apply this by thinking of a team of Agile practitioners working on a software product. The team has a number of generalizing specialists, who have skills spanning across coding, testing, integration, and deployment among others. They are cutting code instead of cutting wood, are testing the soundness of code instead of the solidness of wood, and so on.

Would you ask them to continue working week after week or month after month without ever sharpening their tools? I guess not.

Retrospectives and intraspectives in Agile development do exactly that. They sharpen the saw, or ask us to reflect, rethink, and act with renewed vigor. They provide a better understanding and also help us to work sustainably over a long period. 

Retrospectives

The importance of taking the time for retrospection comes from one of the 12 core principles of the Agile Manifesto.

At regular intervals, the team reflects on how to become more effective, then tunes and adjusts its behavior accordingly.

In Agile, frequent retrospection is done in order to continually improve the effectiveness of the team, project, and organization. The retrospective process consists of two words:

  • Retro – meaning recent past, and
  • Perspective – meaning the way of looking at things.

Hence, you can say that the retrospective is about looking back or dealing with past events or situations for the purpose of improving in the future. You can define the retrospective process as:

A recurring workshop in which the team looks back on their work over a period, reflects upon it, and learns. The team applies this learning in future work to improve people, processes, and products.

One of the widely used iteration-based Agile frameworks is Scrum where every iteration is known as a Sprint. There is a Sprint Retrospective at the end of every Sprint, and it’s an opportunity for the team to inspect itself and create a plan for further improvements. The plan is preferably acted-upon in the next Sprint. Retrospectives are also applicable in flow based Lean-Agile frameworks, e.g., Kanban, where you can have retrospectives on-demand. 

Types of Retrospectives

In iteration-based Agile development, a project is usually divided into releases and each release into various iterations. Hence, for Agile practitioners, there are three types of retrospectives:

  • An Iteration Retrospective: Usually focused on the team involved in the iteration.
  • A Release Retrospective: A wider perspective because it may involve other people in the organization who have contributed to the release, but are not part of the core team.
  • A Project Retrospective: Also has a wider perspective, and is usually from an organizational point of view.

Retrospectives can happen in the following cases:

  • When the team ships something. In a flow-based Agile (like the Kanban method), a release doesn’t happen during a specific time period. It can happen at any time.
  • When more than a few weeks have passed since the last retrospective. Again, in a flow-based Agile process, there is no specific time a retrospective can happen. You can decide in such cases.
  • When the team is stuck (i.e., the work items are not flowing through the team).
  • When the team reaches a milestone. 

Conducting Retrospectives

A retrospective is not a post-mortem meeting, nor should it be a dissection on what events happened wrongly or why. A retrospective should also not be a witch-hunt meeting to put blame on someone or some group. The key to a constructive successful retrospective is for all participants to adhere to the Retrospective Prime Directive, as noted by Norman Kerth, which says:

“Regardless of what we discover, we understand and truly believe that everyone did the best job they could, given what they knew at the time, their skills and abilities, the resources available, and the situation at hand.”

Four Key Questions

Considering the prime directive, there are four key questions in a retrospective, which can also be used when creating your meeting agenda:

  • What did we do well, that if we don’t discuss we might forget?
    (or what is going well?)
  • What did we learn?
  • What should we do differently next time?
  • What still puzzles us?

Look at the wording closely. We aren’t asking what went wrong, rather as the third question goes, we are asking what should be done differently next time.

Five Steps in a Retrospective

A retrospective, as noted, can happen as part of both iteration-based and flow-based Agile frameworks. A retrospective is a process, and it goes through a series of steps. See the figure below. It’s depicts a two-hour (120 minute) retrospective with time spread across the five steps of:

  • Step 1 – Set the Stage
  • Step 2 – Gather the Data
  • Step 3 – Generate the Insights
  • Step 4 – Decide What To Do
  • Step 5 – Close the Retrospective


Let’s understand these steps.

Step 1: Set the Stage

Here the time box (how much time), goal (what you are going to do), approach (how you are going to do it), and work agreements or ground rules are set. If any particular Agile method is used, then the values of that method are announced. The principle of “Every voice and early” is followed, i.e., everyone should speak, and they should speak early. If they don’t speak early, then they may not speak at all!

Step 2: Gather Data

Once the stage has been set, the next step is to gather data. Start with hard data such as metrics, events that’ve happened, or stories completed. Create a visual record having events, story completion, date, etc. The visual is very powerful. Data doesn’t have emotions; therefore, ensure that you bring feelings into the data by asking questions such as, “When were the participants excited to come to work?”

Step 3: Generate Insights

After you have gathered the data, it’s time to evaluate, analyze the data, and provide insights. This step tells the “why” i.e., we generate meaningful insights from the data collected in the previous step. These insights help the team to work more effectively and efficiently – the main goal in any retrospective.

Step 4: Decide What to Do

This step reveals the “what to do” part or the planning part. If you have a long list of decision action items, choose a few, which the team can commit to doing – preferably in the next one or two iterations. A good way to have the action items implemented is to create story cards or backlog items and have them available in the product backlog. Ensure that you assign action items because it drives commitment.

Step 5: Close the Retrospective

In this step, you close the retrospective. When you close the retrospective, don’t forget to appreciate your team for the hard work done during the iteration (or release or project) and during the retrospective.

Retrospective Techniques

In each of these above steps, a number of techniques can be used. We will discuss a few of them. 

Techniques to “Set the Stage”

1) Check in: In this technique, we hope that people put aside their concerns and participate in the retrospective articulating what they want from it. The retrospective leader asks only one question and each person answers in round robin fashion. The answers are usually in one or two words or a short phrase. Example questions can be:

“In a word or two, what you expect from the retrospective?” Or “What is one thing in your mind as we begin the retrospective?”

2) Explorer, Shopper, Vacationers, Prisoners (ESVP) Quiz: Let’s first understand what the letters in ESVP stand for.

  • Explorers: Someone who is eager to know new ideas and insights.
  • Shopper: The participant looks over all information, but is happy to go home with one useful new idea.
  • Vacationers: The participant is not interested and happy to be left out.
  • Prisoners: Someone who thinks that he or she has been forced to attend the meeting and should be doing something else.

In this exercise, each retrospective participant anonymously writes sown his or her position and puts it on a slip of paper or index card. Next, the leader takes the responses and put them into a histogram or a check sheet.


After the results have been collected, you should tear up the cards so that no one is worried about being tracked with handwriting analysis! With this information, you will have a good idea of how your audience feels about the retrospective. This exercise informs about the participants’ attitudes in particular.

Other techniques that can be used in the step of setting the stage are: Focus on/focus off, working agreements, or ground rules. 

Techniques to “Gather Data”

1) Timeline: A timeline is used to stimulate memories of what happened in the time period that just passed. The retrospective participants write down memorable and meaningful events on sticky notes and paste them in chronological order on a board. A sample example is shown below, which in this case, is for an iteration.

 

2) Mad Sad Glad: Here you have three posters labeled – “Mad,” “Sad,” and “Glad.” You can also have color-coded cards or sticky notes. For example: red for mad, yellow for sad, and green for glad.

The team members then put the color-coded cards on the labelled posters and describe times during the project when they felt mad, sad, or glad. This exercise gets the “feeling facts” out on the table.

Other techniques that can be used in this step are: triple nickels, color coded dots, locate strengths, team radar, or like to like. 

Techniques to “Generate Insights”

1) Force Field Analysis: This technique was originally used in a change management context (and also in risk management), but it can be adapted for retrospectives. Here, the team defines a desired state they want to achieve. Then, identifies the following:

  • Driving forces (“forces of change”), which affects the desired state positively.
  • Restraining forces (“forces against change”), which affect the desired state negatively.
  • Factors that can influence reaching the desired state—either by increasing the strength of a supporting factor or by reducing the strength of an inhibiting one.

Utilize a white board and markers with this analytical technique. 


2) Learning Matrix: In this case, participants look at the data generated from four perspectives by brainstorming on them quickly. This is a good technique to use if you are pressed for time. The four perspectives can be put on a flip-chart or white board, each in a quadrant, as depicted in the figure below. 

Brainstorming, Ishikawa diagram, patterns and shifts, and the five whys are some of the other techniques that can be used in this step. 

Techniques to “Decide What to Do”

1) Short Objects: This technique helps to discover differing perspectives on what the team members should or should not do, or should do more or less of. The team brainstorms and put their perspectives on three or two posters or flip charts. The titles of each could be:

  • Same as/More of/Less of (SAMOLO)
  • Stop Doing/Start Doing/Keep Doing (StoStaKee)
  • Keep/Drop/Add
  • What Worked Well/Do Differently Next Time (WWWDD)
  • Smiley/Frowny 

2) Prioritize with Dots: This technique is used to check how the team prioritizes a long list of changes, ideas, issues, or proposals. Here each participant is given 10 dots to be used across the issues. A scale, such as shown in the following bullet points, can be applied.

  • Priority 1 issues receive four dots.
  • Priority 2 issues receive three dots.
  • Priority 3 issues receives two dots.
  • Priority 4 issues received one dot.

The issues that have the most dots are chosen, and those should be focused on.

Other techniques that can be used in this step are: retrospective planning game, SMART (specific, measurable, attainable, relevant, and timely) goals, and circle of questions. 

Techniques to “Close the Retrospective”

1) +/Delta (Plus/Delta): This technique is used to retrospect on the ongoing retrospective and identify areas of strength and areas needing improvement. It starts with drawing a “T” on a flipchart or white board, divided the space into two parts: “+” and “delta.” The items that the team should do more of should be listed under “+” and ones that can be changed by the next retrospective are put under “delta,” which is the Greek alphabet meaning “change.”

 

2) Return On Time Invested (ROTI):

This technique generates feedback on the retrospective process itself and determines the effectiveness of the retrospective session from team members’ perspectives, by asking if the participants believe their time was spent well. You can use a scale rating system (“0” representing a lost cause and “5” indicating a very high return or the highest ROTI).

Other techniques that can be used in this step are: appreciation, temperature reading, helped, hindered, hypothesis (HHH), etc.

 

Intraspectives

The term, intraspective, consists of two words – intra meaning within (or insider) and perspective meaning the way of looking at things. Hence, intraspective is defined as an inspection or reflection for the team, within an iteration. Like a retrospective, an intraspective is a reflecting practice; however, unlike retrospective, it’s often preceded by an event that didn’t go well. Unlike the retrospective process, which can happen at points throughout the project, at the time of a release, or at the project level, the intraspective process happens within an iteration.

Let’s take an example with Scrum to understand. Post daily scrum, the Scrum Master noticed or heard something about consistent failure in release builds due to frequent configuration changes in the build scripts. The Scrum Master calls for an intraspective meeting on it to figure out if change is needed on the way team is modifying build scripts.

In iteration-based Agile methodology, the introspection meeting is, in essence, a retrospective within an iteration. The need for such can also occur in a flow-based Agile project. The purpose of an intraspective is to discuss a particular issue, event, or activity in order to determine if any change(s) are needed in the team’s practices.

The main goals of an intraspective is to inspect and adapt – the two key foundations of empiricism. Intraspectives happens on an ad-hoc or on-demand basis. It also helps in building a self-organizing team. 

Key Points about Retrospectives

Irrespective of the type of retrospective or techniques used in a retrospective, below are a few key points to note while conducting one.

Item #1: Everyone should participate: If you remember the “setting the stage” step, we first discussed a check-in, which asked for everyone’s participation. When there is buy-in from the team as a whole, it is easier to proceed with further actions and improvements.

Item #2: Choose two techniques for each step (one short and one long). There can be many techniques or activities in the five steps of a retrospective. Preferably have one short and one long for each step, and you may altogether skip the shorter one, if you lack time.

Item #3: The Product Owner (PO) should be present: The PO is a core part of the team and should be present at retrospective meetings. As I interact with Agile practitioners, lack of the PO’s involvement has been noted by many as the most pressing issue. It’s important that the owner is a part of reflection discussions.

Item #4: For a longer retrospective, consider breaks. If the retrospective is more than two hours, ensure you have break on your agenda, even if it is just 10 minutes. Schedule breaks when there is a logical breaking point, when the energy level of the team drops, or when team members ask for one.

Item #5: Retrospective is not a post-mortem session. Any meeting that turns into dissecting issues or finger-pointing is futile. The retrospective should never be a whining session, rather an opportunity to contribute, reflect, and plan actions. Remember the story of the woodcutters and the retrospective prime directive, noted earlier.


--

This article was first published by MPUG.com on 15th October, 2019.

 

References

[1] I Want To Be An ACP – The Plain and Simple Way, by Satya Narayan Dash

[2] Agile Retrospectives – Making Good Teams Great by Esther Derby, Diana Larsen, and Ken Schwaber

[3] Agile Practice Guide, by Project Management Institute (PMI)