Can AI solve e-grocery’s erratic out-of-stock substitutions?
Photo: Walmart

Can AI solve e-grocery’s erratic out-of-stock substitutions?

As out-of-stocks became increasingly common in the early months of the pandemic, Walmart’s personal shoppers turned to artificial intelligence to help find the best substitutes.

“The decision on how to substitute is complex and highly personal to each customer,” said Srini Venkatesan, EVP, Walmart Global Tech, in a blog entry. “If the wrong choice is made, it can negatively impact customer satisfaction and increase costs.”

In the past, personal shoppers would determine the best substitute themselves, but Walmart found nearly 100 different factors can go into that decision. Mr. Venkatesan added, “Trying to account for all of these would not only be too difficult, but it would also be incredibly time consuming.”

The AI technology uses hundreds of variables — including size, type, brand, price, aggregate shopper data, individual customer preference and current inventory — to determine the next best available item. It then preemptively asks the customer to approve the substituted item. Whether the substitute is approved or rejected, the information is fed back into the AI’s algorithms to improve the accuracy of future recommendations. Following the technology’s deployment at Walmart, customer acceptance of substitutions increased to over 95 percent. 

It’s unknown the extent to which substitutions are frustrating to consumers. Some customers formed Facebook groups last year, such as “That’s it, I’m Grocery Substitution Shaming” and “Dumb Instacart & Shipt Substitutions,” to lampoon odd replacements.

A survey from late April to early May last year from Retail Feedback Group found 49 percent of online grocery buyers encountering out-of-stocks. Of those, 17 percent were able to purchase acceptable substitutions for all unavailable items, half were able to do so on some and a third found no such substitutions.

One hassle for customers may be the varying methods used by grocers.

A recent review of multiple grocers by the Daily Journal of Kankankee, IL, found that several had apps that allowed personal shoppers to text customers to approve a substitute. One gave shoppers the ability to mark “no substitutions”on their items and another allowed the selection of second and third acceptable choices.

A number of UK-based upstarts including Weezy, Gorillas and Dija are promising speedy deliveries with the help of “no substitutions.”

BrainTrust

"Huge problem, potentially good solution."

Dr. Stephen Needel

Managing Partner, Advanced Simulations


Discussion Questions

DISCUSSION QUESTIONS: Are substitutions a major or minor pain point for e-grocery? Do you think grocers should turn to artificial intelligence or other executional measures to improve the experience?

Poll

32 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Mark Ryski
Noble Member
2 years ago

Substitutions are a pain point, and it’s a difficult problem to solve. While AI often gets bandied around as a solution to solve anything, this is one case where the application of AI could have a meaningful impact on the substitution challenges. Taking the guess work/judgement out of the stock pickers’ hands will be helpful since even well intended stock pickers can make suboptimal choices. At the risk of claiming this to be a panacea – I think it’s an especially good use case.

David Naumann
Active Member
2 years ago

Out-of-stocks and substitutions are a huge frustration for online grocery shoppers and in-store product pickers. Artificial intelligence should help improve substitution decisions. However the root cause is inventory accuracy. Without real-time inventory accuracy, grocers, shoppers and pickers will continue to experience frustrations with out-of-stocks. Accurate, real-time inventory is the Holy Grail.

Richard J. George, Ph.D.
Active Member
2 years ago

Substitutions represent one of the largest compromises retailers ask customers to make. Brand, size, price, etc. all contribute to the customer’s decision-making process. To the extent this can be modeled, the need to do something they don’t want to do or compromise is lessened. Any method or process to handle out-of-stocks needs to be clearly and proactively communicated by retailers.

Neil Saunders
Famed Member
2 years ago

Yes, AI can certainly help as it can quickly assess more data than humans can and come up with recommendations based on past habits and customer profiles. However it won’t always be perfect and it is unreasonable to expect it to be. The best position for retailers is to maintain good stock positions so that substitutions are minimized.

Gary Sankary
Noble Member
2 years ago

AI can solve a lot of things, but predicting brand and flavor preferences of individual consumers is probably not one of them. Food is a very personal item for most consumers. It’s very difficult to understand the attributes they use to choose individual items, and get it wrong and you’re charging a customer for something they don’t want. My recommendation is to ask. I was getting texts from Instacart at one point about what to substitute for missing items. You could also ask the customer if they want to allow substitutions. Bottom line, work on supply chain issues to improve availability.

Dr. Stephen Needel
Active Member
2 years ago

Huge problem, potentially good solution. Two caveats – you need thousands of substitutions for data before the AI solution will be any good and if you keep having out-of-stocks, shoppers will stop coming to your site.

Jennifer Bartashus
2 years ago

Substitutions are a definite pain point for online grocery, and it is an area that needs to be addressed to help minimize shopper frustration and keep people using the services long-term. AI can help with that, especially for retailers that are filling orders from stores since leaving it to human shopper judgment is too risky. Costs to remedy consumer complaints can be higher too – if someone isn’t happy with the substitution retailers make it right with a refund – but that isn’t a sustainable solution from a profit perspective.

Venky Ramesh
2 years ago

Irrelevant substitutions created a lot of frustration last year for online shoppers, personal shoppers, and grocers alike. Many customers were not happy with the substitute – in some cases, it wasn’t even a substitute!

While using AI to solve that problem is commendable, I wonder how brands are planning to handle it. A McKinsey study found that 46 percent of U.S. consumers had migrated away from their usual brand during the pandemic due to product unavailability. Of those, nearly 50 percent expect to make these switches permanent.

Oliver Guy
Member
2 years ago

Fascinating. I question whether the “real-time customer approval” of the substitution can actually work in practice because on-shelf availability can change so much – is the picker going to wait by the shelf until the customer has approved the substitute? Unlikely.

As a shopper, one of the biggest issues I have seen in this area is being prevented from choosing a given grocery item at selection time based on in-store availability at that time of order rather than projected availability at the time the order will be picked. Providing visibility of what is in transit from a DC or supplier is a key ingredient to fix this before AI can have an impact.

In terms of providing recommendations of substitutes, using AI makes sense in terms of driving consistency in approach. While the video talks about 100+ factors involved in making the recommendation, it would be fascinating to understand how deep these go – for example is the wider basket considered, as that could well influence what is and what is not an appropriate substitution.

Ken Morris
Trusted Member
2 years ago

Substitutions are serious. Retailers must find a way to have one single, correct inventory number as close to real-time as possible. AI isn’t magic. It has to follow the “garbage in, garbage out” rule, too.

AI should be used to augment retailers’ ability to approximate real-time inventory at the item level. By augment, I mean using RFID and other technologies to better track inventory throughout the supply chain in the DCs and MFCs, and in the stores. MFCs have the potential to be the keeper of real-time inventory.

Substitutions? Real-time inventory certainly is the only true solution. Short of that, the only fair choice to the shopper is either “no substitutions” or being able to specify exactly which substitutions would be acceptable. There should also be zero back and forth between the shopper (consumer) and the “shopper” (Instacart or whoever is actually picking the order). What the shopper wants is called primary demand — primary demand is what the retailer must know for accurate buying and assortment planning.

Liza Amlani
Active Member
2 years ago

From a consumer perspective, this is a huge pain point especially if you have food allergies. AI would remove the guesswork and simplify the picker’s role where they are hired to just pick product ordered. Infusing technology to better understand the customer as they shop is exactly what we need across all verticals of retail, not just grocery. Smart substitutions or upselling the right products aligned to the customer is how you keep the customer long-term.

Carol Spieckerman
Active Member
2 years ago

AI is a powerful weapon in retailers’ substitution arsenals. Currently, Walmart’s substitution parameters are black and white (allowed or not?). Mr. Venkatesan’s comments explain why parsing substitution criteria is a slippery slope. A good first step is for retailers to make it crystal clear how shoppers can approve/disapprove substitutions and therefore absolve retailers from backlash. The primary opportunity for AI is to avoid out-of-stocks in the first place. The other side of the issue is to ensure that retailers get the sale despite lack of availability for particular items. There is a big gap in perception between retailers having the shopper’s back or pulling a fast one. It’s worth the effort to stay in the first category.

Ananda Chakravarty
Active Member
2 years ago

The pain level is directly proportional to the effectiveness of the retailer’s logistics and supply chain, but substitutions are a critical part of the customer experience for e-grocery as well as physical and omni-grocery. Based on Deloitte’s 2020 Fresh Food Consumer Survey, about 72 percent of stock-outs are substituted – so this definitely drives an important part of the business. As most of us know, stock-outs have been a thorn in many a retailer’s side. AI can help on the substitutions if properly configured and managed. Asking the customer can also help, especially for stable assortments. However at the end of the day this is entirely a logistics, inventory management and demand forecasting issue. Reduce the stock-outs in the first place. AI would be better suited to help manage the demand forecast before worrying about how it addresses the substitutions.

Matthew Brogie
2 years ago

E-grocery needs to do a great job with substitutions if it is going to keep the ground it has picked up during the pandemic. AI is really the only efficient/scalable way to become great at substitutions. Every shopper has their own specific needs, around the particular SKUs they select for their order, and around the process for completing their order cycles. I believe getting a deep understanding of these two facets of the problem is super important to solving it correctly. AI is getting more powerful every day; being able to understand why a shopper selected a particular brand, size, flavor, packaging of a product, how important each factor is for each individual selection, and what occasion the purchase is being made for is critical to getting substitutions right. Couple that with knowing how the consumer wants to proceed when there is an out-of-stock (i.e.; how much control they want in the selection of a substitute) and it is more of a user experience problem to solve.

I’m sure that the AI technology is ready to help A LOT with the problem, and that leaders like Walmart will iterate rapidly to make the experience continuously better for consumers.

Jeff Sward
Noble Member
2 years ago

Seems like real intelligence could play a bigger role before AI steps in. How about some form of ranked choice voting? The need for substitutions is now a known, no-surprises element of e-grocery shopping. It’s great that some grocers seek text approval for substitutions. And “no substitutions” is an option. But how about pre-approved substitutions? Most customers will know in advance what substitutions they can live with. They’ve probably shopped the store dozens if not hundreds of times. They know what else is on the shelf. They know what they’ve tried and accepted and tried and rejected in the past. So how about they spend 10-15 minutes filling fill out some kind of questionnaire so that the grocer has real intelligence on file instead of having to resort to AI as the first alternative? Customers can’t know all the options but they can help by setting some boundaries up front.

Dave Wendland
Active Member
2 years ago

Yes — and no. Properly applied and managed, out-of-stocks can be satisfactorily alleviated with AI. However if the core data and rules are “bad” (which is too often the case when combining disparate data sources), the results can be a disaster.

To address this haunting retail pain point, AI efforts must begin with a thorough understanding of incoming data sources, a single and universal “source of truth” for every item, and a merchant to establish the rules. Short of this, someone may get calculators instead of pasta.

Lisa Goller
Trusted Member
2 years ago

E-grocery out-of-stocks, expired items and product omissions are major pain points. Substitutions are a moderate pain point that can make us reconsider in-store shopping to gain certainty of what we’re buying.

Yes, grocers need to consider investing in tech to stay competitive by aligning with consumers’ expectations. AI allows exact product matching, so grocers can offer substitutes that satisfy shoppers’ specifications.

David Weinand
Active Member
2 years ago

If AI can help with accuracy and efficiency, it should play a role in the e-grocery shopping experience. Any shopper that has used e-grocery for any period of time knows substitutions will be a part of their cart – so if a grocer can reduce the dissatisfaction with the substitute – it’s a win for both the shopper and the grocer.

Dave Bruno
Active Member
2 years ago

In my opinion, substitutions are among the greatest threats to online grocery shopping customer satisfaction. Walmart is smart to invest in technology to help improve this significant pain point. I think AI can help, but I am not convinced it will eliminate the problem entirely. However even modest improvements will have a significant impact on the shopping experience, and could potentially be differentiating.

Jeff Weidauer
Jeff Weidauer
Member
2 years ago

Out-of-stocks have been a problem in grocery retail for years. Most research shows that one in eight shoppers leaves the store without at least one item they went in for. Ordering online has made the OOS challenge exponentially worse, and while AI may help in the substitution process it only addresses the symptoms, not the problem.

Ricardo Belmar
Active Member
2 years ago

Stock-outs and substitutions are likely the number one issue causing dissatisfaction in online grocery purchases for consumers. AI is a good technology to apply to this challenge, however there is the issue of training the AI to reach an effective success rate. Kudos to Walmart for promoting this as a solution and setting the expectation with customers that their substitutions will get better over time. The question is, how long will it take, per customer, for the AI to make not only better choices but the right choice in that customer’s mind? The best way to solve this problem is to prevent stock-outs. I would hope that retailers leveraging AI for the substitutions are also using AI to create better forecasts for replenishing those store shelves with the right products to avoid the stock-outs in the first place! This is very much like discussions around returns in e-commerce – the more you can prevent them (using AI), the better your customer experience!

Karen Wong
Member
2 years ago

AI is definitely a good option for optimizing the substitution process and improving customer experience. The problem is that many retailers still haven’t automated the problem one step behind substitutions – real-time stock availability. It is hard to act on substitution pain points if you don’t even know when you’re actually out of stock.

Ryan Mathews
Trusted Member
2 years ago

Substitutions may be a deal breaker for “e-grocery” — nice to see the “e-” is making a comeback, by the way. Consumers aren’t going to reward you for being out-of-stock and coming closest to getting them what they want because, well, they want what they want. AI can get us to a “better worse choice” but the only way to get to a good choice is to give the consumer what she or he is asking for.

Shep Hyken
Active Member
2 years ago

Substitutions due to “out-of-stock” are frustrating to both the customer and the retailer. However they also present opportunities. It’s one thing to say, “We are out, so try this.” It’s another to explain why it’s a good option. With the right message, this can actually be an opportunity that turns frustration into delight.

Melissa Minkow
Active Member
2 years ago

AI is a great tool for minimizing the substitution pain point. That said, this is one area where shopping in person yourself will always trump e-grocery. If you’re out already, you may make the decision to shop a few other nearby stores and make sure you end up with the item you wanted. It would be great to see grocers and third-party picking apps find a creative, non-threatening solution to allowing multi-store shops when an item is out of stock.

Gib Bassett
2 years ago

We all experienced this problem at the onset of the pandemic and sometimes there were no substitutions. Of course it still happens but the fact that Walmart has achieved 95 percent acceptance by customers of AI-proposed substitutions seems evidence enough that it works at scale.

Low satisfaction of substitutions cited in mid-2020 had way more to do with supply chains caught off guard upstream of stores due to panic buying.

Interestingly, data gathered by customers’ accepting substitutions provides Walmart with insight into supplier diversification strategies that can leverage AI to predict disruptions in supplier networks to avoid this shopper friction to begin with.

That simple example highlights why it’s best practice to think about your AI use cases beyond siloed problems and rather across the business.

Doug Garnett
Active Member
2 years ago

No. I don’t think that AI will solve this problem for e-grocery. When an item is out of stock — that item is out of stock. Customer dissatisfaction might be expressed as “I didn’t like the substitute” but the true problem is “the item I wanted was out of stock.”

The trickiest issue here isn’t something AI can deal with — sometimes a substitution is reasonable and sometimes it’s better not to substitute anything.

(As a note: We have discovered why it is so much more valuable to shop in the store — we make all of our own choices to satisfy ourselves. And we will make choices no AI could ever make for us.)

Andrew Blatherwick
Member
2 years ago

Those e-grocers should focus more on reducing their out-of-stocks, then they would not have such a big problem. The trouble is they focus everything on the “Customer Experience” at purchase point and forget about the “Customer Experience” of not getting what they ordered. AI is a very valuable tool and can undoubtedly help but it can be much more effectively employed providing a world class inventory management solution to reduce out-of-stocks to an absolute minimum.

John Karolefski
Member
2 years ago

Of course, substitutions are a pain point for shoppers. Whether it’s major or minor pain point depends on the attitude of shoppers. Sometimes the “substitutions” can be way off base and indeed funny. Should grocers turn to AI for help? Of course. Anything that improves service to customers should be embraced.

James Tenser
Active Member
2 years ago

Using fancy tech to make ecommerce item substitutions better is wallpaper covering the real source of the problem — poor inventory intelligence.

Retailers must get store (and dark store) inventories right. Maintain a reliable perpetual inventory and forecast (here is where AI might be pretty useful). Incorporate both in-store and digital demand in the process.

Inventory intelligence should make stock-outs exceedingly rare so that substitutions are even rarer.

Don’t institutionalize an awful customer experience by using an imperfect AI to make substitutions marginally better. Make them go away instead.

Jlauderbach
2 years ago

Out-of-stock items are a huge issue for brick and mortar and e-grocery. Only e-grocery has the data to identify the magnitude. When a shopper is in a store and selects another product for one that is out of stock only the shopper knows. AI may identify trends that can change ordering algorithms but if the supply chain does not have the inventory, the store still has an out-of-stock. The out-of-stock issue is exacerbated by trade promotions which can incent grocers to order items that are not demanded. This inflates inventories and impedes product rationalization.

AI may assist in issue identification, but there are many variables in this problem it cannot address.

Mary Pietsch
Mary Pietsch
2 years ago

If AI can successfully identify the attributes most important, it could be helpful but given the variability of attribute importance across different people, it would be difficult to achieve. A good option is to allow consumers to easily identify a group of acceptable substitutes (e.g., any other zero calorie cola). Currently, if this option is even available, it is cumbersome to use.