post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

Sunday Rewind: Whose job is it anyway? The rise of Product Ops and why it deserves to be an independent function

Guest Post

Creating metrics that matter

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

How much are product managers getting paid in 2024?

Leading product ops at Delivery Hero with Koen Dubelaar

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Everything wrong with the product management job market. And how to fix it

Ian Haynes is a digital marketing specialist and has successfully deployed over 500 pages of content as a ghostwriter for businesses of all sizes. He believes that for people to truly value your business and perceive it as a brand, your content needs to do much more than just inform, it needs to talk, engage, and convert. Outside of his work, Ian likes exploring Brooklyn with his Labrador.

Ian Haynes

<p>Large IT firms aren&#8217;t the only ones employing artificial intelligence in production and distribution operations. Whether companies take a cautious approach or leap headfirst, AI programs are gaining popularity across many industries, from the automobile to retail, education, and healthcare.</p>
<p>In this <a href="https://www.mindtheproduct.com/producttank/" target="_blank" rel="noopener">ProductTank Tokyo</a> talk, <a href="https://www.linkedin.com/in/hiroki-nakamura/" target="_blank" rel="noopener">Hiroki Nakamura</a> examines an AI Product Manager&#8217;s tasks and how AI is transforming the product management industry. According to Hiroki Nakamura, here are the important roles that an AI product manager plays in managing the quality of the products:</p>
<h3>Perceiving the issues in AI model quality</h3>
<p>The three essential elements of product management are user experience, business, and technology, and they should remain the same when using generative AI. However, the technology field is full of uncertainties. Maintaining the AI model in addition to the software technology is crucial, just like with conventional apps and services.</p>
<p>You might be able to focus on accuracy without giving cost much concern if the AI models are lightweight. On the other hand, generative AI makes correct content that meets user expectations using huge AI models. If the AI model is vast, the hosting server requirements and supply costs are not trivial and often hard to manage &#8211; unless the company is very well endowed.</p>
<h3>Looking for flaws in the product and providing measures</h3>
<p>Even if you optimize for Precision/Recall, it will never be flawless. Therefore, you must consider how to deal with that flaw throughout the procedure. This holds true for cognitive AI models as well as generative AI models.</p>
<p>In generative AI models like conversation generation, erroneous speech is very hard to prohibit. Therefore, the ideal course of action is integrating new methodologies while striving for perfection in the AI model. In the case of a conversation-generating AI model, a filtering system, such as a rule-based system, can be employed to multiplex the input from the user and the output created by the AI model.</p>
<h3>Ensuring faster iteration of the AI models</h3>
<p>In many circumstances, it could be difficult to accurately anticipate how good generative AI will be. It might be possible to forecast the result if recognition-based AI has a history. The evaluation method itself changes depending on the service&#8217;s direction, and relatively few examples of generative AI are applied to actual goods, making it difficult to set a quality target and predict the point of achievement based on past performance.</p>
<p>To quickly iterate, improvements are the best approach for making predictions. There are two critical measures to take in order to iterate quickly. The first step is maintaining the separation between the models-improvement and service-implementation processes.</p>
<h3>Considering the costs for pre-generating methods</h3>
<p>If neither of these problems exists, there is no good reason not to create the traffic in real-time, especially considering the cost of real-time production for the anticipated traffic and the effect of the generation time on UX or user experience.</p>
<p>However, it should be discontinued if real-time manufacturing is too costly to run continually or takes too long to make a single instance. In such cases, one option is to create a substantial portion of the content offline beforehand and select from the pre-made content for use in the service before deciding not to utilize the developed model.</p>
<h2>Key takeaways</h2>
<p>Some critical notes that Hiroki Nakamura gave during his interview about the role of an AI product manager were:</p>
<ul>
<li>Consider the costs for pre-generating methods</li>
<li>Perceive the issues in AI model quality</li>
<li>Look for flaws in the product and providing measures</li>
<li>Ensure faster iteration of the AI Models</li>
</ul>
<p>Even if it were made available as a tool as it is, Hiroki thinks generative AI is still too difficult to handle to be included in and utilized as a part of a product. However, with the right application, it is possible to create new services unrelated to anything that has come before. Furthermore, because technology is evolving quickly, you can leverage it to your advantage by deploying and updating it as new developments occur.</p>
<p><a href="https://www.mindtheproduct.com/producttank/" target="_blank" rel="noopener">Learn more about ProductTank</a> – find your local meetup, explore more ProductTank content, see the latest ProductTank news, and discover ways to get involved!</p>

core/freeform

AI ethics advice from former White House technologist – Kasia Chmielinski (Co-founder, The Data Nutrition Project)

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

LLM workflows for product managers: 3 key takeaways (Niloufar Salehi, Assistant Professor at UC Berkeley) – ProductTank SF

The future of product management: Insights from ProductTank San Francisco

Product lessons learned making early moves with AI in media: Lindsey Jayne (CPO, Financial Times)

A year with ChatGPT and product innovation: Navigating the AI landscape

How to keep your head about generative AI (when everyone is losing theirs) by Claire Woodcock

The role of an AI product manager by Hiroki Nakamura

Ian Haynes