Yelp, Facebook & Healthcare Mystery Shopping

In the era of Yelp, Facebook and online forums, where patients can report anything at all to the Googling masses; where your competitive advantage partially rests on patients’ perceptions of your listening, caring and respect, gathering detailed, objective, comprehensive and actionable accounts of patient experiences are even more important than ever. The usual research methods of focus groups, surveys family councils and rounding, etc., help in various ways, but they don’t tell the whole story of the patient experience. To do that requires a very special kind of knowledge and insight that can only be acquired through multiple and comprehensive patient experience accounts or exhaustive direct observation of people and processes. It’s why service industries such as hotels, airlines and restaurants use Mystery Shoppers to evaluate the customer experience. Today, mystery shopping is a 2 billion dollar plus industry. However, only a small amount is healthcare’s share, perhaps because its methods, benefits, opportunities and/or perceived threats are not widely understood. Whether that may be changing is unclear.

Mystery Patients Go Undercover

In today’s world of Facebook, Yelp, online communities, forums and rating websites, there are plenty of opportunities for patients to communicate their complaints and opinions publicly about their medical experiences — both good and bad. Yet, for the most part, patients tend to reserve their feedback for family and friends, unless specifically asked.

Barriers such as…

  • Public website criteria for critiques
  • Physicians’ particular sensitivities about their reputations (e.g. requiring that patients sign agreement promising not to post comments on public sites, even though these agreements may not be enforceable), and
  • The “risks” to dissing providers publicly, or even, conceivably, being sued

can be deterrents to the public communication of patient complaints

In addition to the above barriers, there are the deterrents of time and energy. Creating an effective factual, verifiable description of your problem or complaint, searching for the appropriate website, or composing a letter to the hospital president, the physician or to the clinic manager take too much time, energy.

A Personal Story

I’ll never forget my experiences a couple of years ago when my husband had a life threatening bout with MRSA/sepsis. In an earlier blog, I mentioned a few of the particulars of our experience in the registration/triage areas of the Emergency Department before my husband was admitted to the hospital. But the story didn’t end there. Although he went on to be seen by a wonderful ED physician who suspected the seriousness of my husband’s condition, and to have excellent doctors in the hospital who put him on the road to recovery, when my husband was discharged 17 days later, late in the day, with a PIC line and orders for IV antibiotics twice a day from a home infusion provider — things fell apart. No antibiotics were delivered. No nurse was assigned by the home health provider to administer the first three IVs, or teach me how to do it. How did this happen?

Unbeknownst to us, the infusion company was confused about my husband’s unusual drug coverage and came to the erroneous conclusion that he had no coverage. As a result, the infusion company did not deliver the antibiotic that was ordered. Then the staff member responsible for verifying his insurance failed to inform the company’s care coordinator, the hospital or us about the problem before discharge. To make matters worse, the infusion company did not make arrangements with an approved home health company to provide the nurses who would manage my husband’s care or administer the first dose of antibiotics.

Faced at home with this stressful situation, the natural response of most patients and families would be to call the primary care doctor and/or return to the ER. But, it was evening, and my husband refused to go back to the hospital. Rather than fight that battle right then, I started making phone calls.

Fortunately, because of my prior experience in hospital management and some (limited) understanding about insurance coverage, I was able figure out whom to call, what questions to ask, what to say and what to demand. Nevertheless, it took an enormous effort on my part, including multiple phone calls, pleading, offering to pay cash for the medicine, and even screaming at people to persuade the infusion company’s regional manager to approve having several doses of the antibiotic delivered and to get a nurse from the home health company to our home late that night.

Ready for ED-CAHPS?

With the final ED – CAHPS survey (The Emergency Department Consumer Assessment of Healthcare Providers and Systems) expected to become mandatory sometime in late 2015 or early 2016, now is the time for hospitals to make sure they have sufficient, in-depth, feedback about patients’ perceptions of their experiences in their emergency department. The survey from CMS will assess information about the patient experience during arrival in the Emergency Department, during care, and after being admitted to an inpatient unit or discharged from the ED.

More specifically, the final surveys will ask questions about how quickly patients receive initial care, the perceived quality and timeliness of communication with nurses and doctors, wait times, medication and pain handling, interpreter services and discharge instructions — plus the overall rating of care and likelihood to recommend the hospital to others. The Centers for Medicare & Medicaid Services (CMS) is still testing the draft surveys.

Similar to HCAHPS on the inpatient side, CMS’s goal in developing the Emergency Department version of CAHPS is to better understand the ED experience from the patient’s perspective, allow for objective comparisons of the care that patients receive, and improve the quality of Emergency Department visits across the country. Likewise, a portion of Emergency Department reimbursement is expected to eventually be tied to the hospital’s ED-CAHPS scores.

Unlocking the Patient Experience: Mystery Shopping or Ethnography?

The research methods that produce the richest insight into patient satisfaction and the patient experience tend to be qualitative – e.g. mystery shopping, ethnographic studies. Qualitative methods can be messy, harder to analyze and less conclusive than quantitative research, but they often provide abundant, detailed information about systems and behavior not uncovered by quantitative methods alone. When patients tell you in their own words what happened, how they perceived what happened and “why” they felt the way they did, powerful insights and actionable information emerge.

Which Technique Should We Use?

Mystery shopping — Mystery shopping uses incognito “shoppers” posing as real patients to provide detailed feedback about their experiences. The mystery shoppers make surreptitious notes about each interaction as it occurs. Afterwards, they prepare detailed reporting about their experiences. Even a small group of reports can be very useful for uncovering patient expectations and presenting a graphic picture of your strengths and opportunities for improvement.

The kinds of mystery shopping assessments DHA professionals can perform are almost limitless. Those requested most include telephone calls, outpatient, inpatient, ER, clinic and competitor visits. In most cases, the mystery shoppers proceed through the entire inquiry, scheduling, registration, treatment and discharge processes. We’ve even gone up to the point of surgery. Occasionally we have requests for observation only visits, “shadowing,” or pairing mystery shoppers as companions to real patients.

Ethnography — Ethnographic studies depend on one or more observations and interviews conducted by DHA consultants. Ethnography is a relatively long-term, labor-intensive process. It requires consent from carefully chosen participants, sufficient …

A Different View: When Doctors Become Patients

In the September 2013 issue of the Allegheny Medical Society Bulletin, Dr. Fred Rubin provides a first-hand account of his experience as a patient in the hospital where he works. He recalls the various tests, procedures, diagnosis and care he received in the Emergency Department and during his 14-day hospital stay.

Dr. Rubin describes the frustration of sleep-disrupting procedures and the helplessness he felt as he lost control of his body. In summarizing the “good and the bad” of his time spent as a patient, he concludes that his overall hospitalization was a “terrible experience.”

Although this likely wasn’t what hospital management wanted to hear, Dr. Rubin’s knowledge of the hospital’s policies and procedures — along with his expertise as a physician — put him in the ideal position to suggest changes to improve the patient experience.

I had a similar opportunity when my husband, a physician, needed emergency care last fall. My background as a hospital executive and a medical mystery shopper enabled me to “see” instances worth reporting to management as I sat by my husband’s side during his visit to the hospital’s Emergency Room, his 17-day hospital stay and discharge to home care. Like Dr. Rubin’s account, there were good and not so good experiences.

Mystery Patients Lend Eye Opening Insight into Healthcare Operations

In the January 2, 2014 Hospital Impact blog, Jason A. Wolf, president of the Beryl Institute suggested that finding the greatest opportunities for excellence and improvement in the patient experience comes back to a willingness to constantly ask questions, try new things and avoid being lured in by promises of “best practices” or prepackaged solutions.

I found Jason’s comments interesting when thinking about why more healthcare organizations don’t try mystery shopping to take their service and patient satisfaction to the next level. Unlike other service industries that routinely use mystery shopping reports to increase customer satisfaction and retention, many healthcare leaders are reluctant to take advantage of this powerful decision-influencing tool. It’s sometimes perceived negatively as a “gotcha” program rather than a way to make factual observations or a way to assess performance against standards.

The mystery shopping report

Mystery shopping reports are produced by individuals who know how to think, speak, and behave like “real” patients. These individuals have fictitious but believable symptoms, complaints or needs. Sometimes a doctor or two is involved in the plan. As ER patients, outpatients and inpatients, or as callers scheduling appointments and making inquiries, the mystery shoppers inconspicuously take notes about their encounters and observations, and turn these notes into a clear and insightful first-hand account of their entire experience. Depending on what the organization wants to know about its operations, the compilation of these individual accounts plus associated questionnaire responses are then turned into detailed reports that:

Positive Inpatient Experiences are Nice AND Necessary

The New Year brings a new change in the way DRG reimbursement is distributed. The reimbursement implications are significant, and many hospitals either have lost or will lose much needed federal funding, or collect sizeable incentive payments.

Which outcome will your hospital achieve?

As you know, one factor that determines whether your hospital receives an incentive payment or gets hit with a reduction in DRG reimbursement is inpatient satisfaction. That’s because Medicare’s Value Based Purchasing Program weighs inpatient satisfaction as 30% of a hospital’s performance score.

For this year, up to 1% of DRG reimbursement was at stake at underperforming hospitals. Next year, the percentage increases to 1.25% and increases again in 2017 to 2%. Even if yours is considered a top-performing hospital in its region, its DRG reimbursement may still be at risk because your facility is now being compared to the top 5% of ALL hospitals, with rolling benchmarks.

In anticipation of this change, hospital executives have been retraining staff and revising policies and processes with the goal of improving quality and increasing patient satisfaction at their facilities. Perhaps that’s what you’ve done, too.

Does your Nurse Recruitment Process Communicate the Right Messages to Qualified Applicants?

Long gone are the days when nursing applicants were the only ones that needed to create favorable first impressions during interviews.

With demand for qualified nurses exceeding supply, the tables have turned. Nowadays, qualified nursing applicants have many options when choosing where they want to spend their working hours. So, in order to attract “the best of the best,” your nurse recruitment team and processes must also impress potential applicants.

As always, nursing applicants want information about the job, the pay, and the benefits. But today’s applicants are looking beyond facts and figures to find the “right fit” when evaluating job options. Believe it or not, their initial impressions about a potential employer are often influenced by simple, subtle details such as how a staff member handles their calls, how long they’re made to wait for a response, and how communication is handled before, during and after an interview.

At all times, staff convey important messages about your organization’s culture, operations, and attitudes toward employees, physicians, patients or residents. Positive messages can influence potential applicants to choose your organization over a competitor’s.

Let Medical Mystery Shoppers Help Improve Your HCAHPS Scores

Today’s patients are armed and potentially dangerous – but not with handguns or grenades. Their weapon is the Hospital Consumer Assessment of Health Providers and Systems, or HCAHPS. And how patients respond to this standardized national survey could be risky to your facility’s bottom line.

When asked to participate in the HCAHPS survey, many patients are telling it like it is – or at least the way they perceive it to be. But perception is a problem with this tool that promises a more consistent and comparable way to measure patient satisfaction. That’s because perception is subjective, and even though participants can respond with only one of four answers — either “always,” “sometimes,” “usually” or “never” — their responses can still be skewed by their perception of how they and their care were handled.