By clicking “Accept All Cookies”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts.
No items found.

Navigating hopes & fears surrounding AI in healthcare

Navigating hopes & fears surrounding AI in healthcare

At Daylight, all of our project kickoffs end with a “Hopes and Fears” session. We invite our clients to express those very things, hopes and fears, which are usually written down on Post-its and then discussed. It’s a way to pull out and explore concerns, expectations, and limitations, and it’s a conversation we love because it holds so much value: It leaves us with insights that guide the work. What’s fascinating is how often the hopes and fears take shape as an expression of the same topic, just approached from opposite ends.

<svg width="1440" height="810" viewBox="0 0 1440 810" fill="none" xmlns="http://www.w3.org/2000/svg"> <g clip-path="url(#clip0_205_356)"> <path d="M-106 616C-74.745 581.733 -56.0143 521.322 36.0681 505.236C152.564 484.884 124.529 572.815 86.8067 551.156C48.8655 529.372 104.667 429.571 248.764 415.482C359.629 404.641 397.733 413.916 526 438.442" stroke="#121AFF" stroke-width="16.1869"/> <path d="M543.386 440C598.075 447.075 495.071 477.797 304.611 466.785C217.206 461.731 252.852 487 261.641 487" stroke="#121AFF" stroke-width="16.1869" stroke-linecap="square"/> <path d="M284 490.006C335.262 488.958 535.195 637.592 759.518 664.927C961.785 689.573 1258.96 664.927 1485 490.006" stroke="#121AFF" stroke-width="16.1869" stroke-linecap="round"/> </g> <defs> <clipPath id="clip0_205_356"> <rect width="1440" height="810" fill="white"/> </clipPath> </defs> </svg>
<svg width="1440" height="810" viewBox="0 0 1440 810" fill="none" xmlns="http://www.w3.org/2000/svg"> <g clip-path="url(#clip0_205_356)"> <path d="M-106 616C-74.745 581.733 -56.0143 521.322 36.0681 505.236C152.564 484.884 124.529 572.815 86.8067 551.156C48.8655 529.372 104.667 429.571 248.764 415.482C359.629 404.641 397.733 413.916 526 438.442" stroke="#121AFF" stroke-width="16.1869"/> <path d="M543.386 440C598.075 447.075 495.071 477.797 304.611 466.785C217.206 461.731 252.852 487 261.641 487" stroke="#121AFF" stroke-width="16.1869" stroke-linecap="square"/> <path d="M284 490.006C335.262 488.958 535.195 637.592 759.518 664.927C961.785 689.573 1258.96 664.927 1485 490.006" stroke="#121AFF" stroke-width="16.1869" stroke-linecap="round"/> </g> <defs> <clipPath id="clip0_205_356"> <rect width="1440" height="810" fill="white"/> </clipPath> </defs> </svg>

At Daylight, all of our project kickoffs end with a “Hopes and Fears” session. We invite our clients to express those very things, hopes and fears, which are usually written down on Post-its and then discussed. It’s a way to pull out and explore concerns, expectations, and limitations, and it’s a conversation we love because it holds so much value: It leaves us with insights that guide the work. What’s fascinating is how often the hopes and fears take shape as an expression of the same topic, just approached from opposite ends.

A monumental project is now underway. We are all Generative AI’s potential clients, and we have embarked on this journey with a mixture of hope and fear. One of the trickiest aspects about AI is that we don’t yet know all the fears. Some will be irrational, others grounded in anticipation. But all will provide valuable insights that can and should steer our future endeavors.

Of the many fields we work in at Daylight, healthcare is one we’re particularly passionate about and involved in, so much so that we have a licensed physician as part of our team.This time, we allowed ourselves to be the client, with Post-it Notes of our own that capture our hopes and fears around AI as it relates to specific healthcare challenges.

The four that stood out most to us underscore the inevitable trade-offs associated with disruptive innovation— and emphasize the pivotal role of human-centered design to recognize and mitigate potential risks.

Project
Authors
Sabine Müllauer
Tom Hynek

Efficiency

Keyboard Liberation: Increase doctor-patient interaction by letting AI handle administration

It’s a recurrent issue we have encountered over 25 years of consulting: excessive administrative tasks significantly hinder healthcare professionals from delivering an optimal patient experience. When asked about their primary wish, doctors consistently express the desire to "eliminate administration and liberate time for genuine caregiving duties." The numbers bear that out. One survey of US clinicians found that 36% reported spending more than half their time on administration, with a staggering 92% saying administration is a major contributor to burnout. Those numbers underscore just how deeply and widely the administrative burden is felt and stress the critical need for streamlined solutions in our pursuit of transformative healthcare practices. AI has the power to grant that wish.

and yet...

In order to facilitate this, digital upskilling is necessary. But is it doable? Healthcare in particular suffers from a shortage of tech-savvy professionals. How healthcare providers would use all that additional time is also untested. What if instead of spending more time with patients by outsourcing administrative duties, they instead scale their business? Would that help solve our shortage of healthcare workers but just substitute one type of burnout for another? Could doctors see their connection to medicine fray by losing the time-consuming yet valuable step of typing up patient notes?

Empathy

The Individual Context: Improve treatment efficiency and safety using precision medicine

AI holds the promise of revolutionizing healthcare by enabling precision medicine tailored to individual patient needs. Advanced algorithms can analyze vast datasets, unlocking personalized treatment plans that consider genetic, environmental, and lifestyle factors. This targeted approach has the potential to enhance treatment efficacy while minimizing adverse effects and could be particularly groundbreaking when it comes to how we treat cancer, whose heterogeneity means that patients who have the same tumor and undergo identical treatment plans can end up with divergent results.

and yet...

The cost of implementation might be prohibitively expensive, creating a major roadblock for societies with statutory health care and jeopardizing access for those with privately funded healthcare. Could AI widen the gap between the haves and the have-nots? AI algorithms are only as strong as the data on which they rely, and that introduces new potential pitfalls around data privacy and security, informed consent, and the accuracy of medical records. Could AI algorithms built using today’s data further entrench the biases that already exist in healthcare

Accuracy

Google on Speed: Make more accurate medical information and assessment available everywhere

The abundance of readily available medical information has surged. Understanding blood oxygenation levels, assessing stroke or breast cancer risk, and learning about preventive measures are within easy reach. AI will make it exponentially more so. This marks a significant shift from the traditional reactive healthcare model towards a proactive approach to prevention. It represents a valuable tool long sought by healthcare professionals, one that could provide individuals with immediate feedback and reinforcement for positive behavioral changes

and yet...

Who will contextualize this wealth of data? Where is the “human in the loop” who can address the nuanced determinations or recommendations that AI generates? And how can we ensure that the information people are accessing is based on sound and thorough data? It’s a point that was emphasized by Dr. David Newman-Toker, M.D., Ph.D., in a congressional hearing on AI in healthcare. Utilizing the wrong data —"Garbage in, garbage out"— can perpetuate biases, while relying on inadequate data — "Go where the light is best" — can foster a skewed perspective.

Opportunity

Absolute Health Is Impossible: The way we look at our health status could change

Machine learning algorithms excel at discerning subtle patterns that may signify conditions like cancer or cardiovascular diseases, enabling timely interventions and enhancing patient outcomes. However, AI's proficiency in pattern recognition could extend beyond mere detection; it could act as a sort of medical crystal ball, providing valuable insights into future developments and the likelihood of developing specific conditions. Indeed, one recent study found Alzheimer’s could be detected seven years before it emerged using AI. AI's potential to forecast diseases could allow us to prevent ailments from progressing to untreatable stages and empower individuals to modify their behaviors proactively.

and yet...

In this new world, would the concept of being "healthy" even be possible? In a realm where one is either diagnosed or not diagnosed enough, are we all staring down a disease-ridden future? What happens to those people who lack the ability, finances, or motivation to act on the information, or those who are anticipating a disease for which no treatment yet exists? Could insurance providers discriminate based on some algorithm, with no recourse for patients who are denied coverage?

Conclusion

Dualities tend to live within any disruptive innovation, and Generative AI in healthcare is no exception. As we do the work of bringing its full potential to life, it’s imperative that we consider the practical and ethical implications at the same time. The hopes are plentiful, as are the fears, and the dialogue they produce is one we’ll use to guide our work. What hopes and fears would you write on a Post-it when it comes to AI in healthcare?

No items found.