M.B.A. Students vs. ChatGPT: Who Comes Up With More Innovative Ideas?
Kanebridge News
    HOUSE MEDIAN ASKING PRICES AND WEEKLY CHANGE     Sydney $1,599,192 (-0.51%)       Melbourne $986,501 (-0.24%)       Brisbane $938,846 (+0.04%)       Adelaide $864,470 (+0.79%)       Perth $822,991 (-0.13%)       Hobart $755,620 (-0.26%)       Darwin $665,693 (-0.13%)       Canberra $994,740 (+0.67%)       National $1,027,820 (-0.13%)                UNIT MEDIAN ASKING PRICES AND WEEKLY CHANGE     Sydney $746,448 (+0.19%)       Melbourne $495,247 (+0.53%)       Brisbane $534,081 (+1.16%)       Adelaide $409,697 (-2.19%)       Perth $437,258 (+0.97%)       Hobart $531,961 (+0.68%)       Darwin $367,399 (0%)       Canberra $499,766 (0%)       National $525,746 (+0.31%)                HOUSES FOR SALE AND WEEKLY CHANGE     Sydney 10,586 (+169)       Melbourne 15,093 (+456)       Brisbane 7,795 (+246)       Adelaide 2,488 (+77)       Perth 6,274 (+65)       Hobart 1,315 (+13)       Darwin 255 (+4)       Canberra 1,037 (+17)       National 44,843 (+1,047)                UNITS FOR SALE AND WEEKLY CHANGE     Sydney 8,675 (+47)       Melbourne 7,961 (+171)       Brisbane 1,636 (+24)       Adelaide 462 (+20)       Perth 1,749 (+2)       Hobart 206 (+4)       Darwin 384 (+2)       Canberra 914 (+19)       National 21,987 (+289)                HOUSE MEDIAN ASKING RENTS AND WEEKLY CHANGE     Sydney $770 (-$10)       Melbourne $590 (-$5)       Brisbane $620 ($0)       Adelaide $595 (-$5)       Perth $650 ($0)       Hobart $550 ($0)       Darwin $700 ($0)       Canberra $700 ($0)       National $654 (-$3)                UNIT MEDIAN ASKING RENTS AND WEEKLY CHANGE     Sydney $730 (+$10)       Melbourne $580 ($0)       Brisbane $620 ($0)       Adelaide $470 ($0)       Perth $600 ($0)       Hobart $460 (-$10)       Darwin $550 ($0)       Canberra $560 (-$5)       National $583 (+$1)                HOUSES FOR RENT AND WEEKLY CHANGE     Sydney 5,253 (-65)       Melbourne 5,429 (+1)       Brisbane 3,933 (-4)       Adelaide 1,178 (+17)       Perth 1,685 ($0)       Hobart 393 (+25)       Darwin 144 (+6)       Canberra 575 (-22)       National 18,590 (-42)                UNITS FOR RENT AND WEEKLY CHANGE     Sydney 6,894 (-176)       Melbourne 4,572 (-79)       Brisbane 1,991 (+1)       Adelaide 377 (+6)       Perth 590 (+3)       Hobart 152 (+6)       Darwin 266 (+10)       Canberra 525 (+8)       National 15,367 (-221)                HOUSE ANNUAL GROSS YIELDS AND TREND         Sydney 2.50% (↓)       Melbourne 3.11% (↓)       Brisbane 3.43% (↓)       Adelaide 3.58% (↓)     Perth 4.11% (↑)      Hobart 3.78% (↑)      Darwin 5.47% (↑)        Canberra 3.66% (↓)       National 3.31% (↓)            UNIT ANNUAL GROSS YIELDS AND TREND       Sydney 5.09% (↑)        Melbourne 6.09% (↓)       Brisbane 6.04% (↓)     Adelaide 5.97% (↑)        Perth 7.14% (↓)       Hobart 4.50% (↓)       Darwin 7.78% (↓)       Canberra 5.83% (↓)       National 5.76% (↓)            HOUSE RENTAL VACANCY RATES AND TREND       Sydney 0.7% (↑)      Melbourne 0.8% (↑)      Brisbane 0.4% (↑)      Adelaide 0.4% (↑)      Perth 1.2% (↑)      Hobart 0.6% (↑)      Darwin 1.1% (↑)      Canberra 0.7% (↑)      National 0.7% (↑)             UNIT RENTAL VACANCY RATES AND TREND       Sydney 0.9% (↑)      Melbourne 1.4% (↑)      Brisbane 0.7% (↑)      Adelaide 0.3% (↑)      Perth 0.4% (↑)      Hobart 1.5% (↑)      Darwin 0.8% (↑)      Canberra 1.3% (↑)        National 0.9% (↓)            AVERAGE DAYS TO SELL HOUSES AND TREND         Sydney 28.7 (↓)       Melbourne 30.7 (↓)       Brisbane 31.0 (↓)       Adelaide 25.4 (↓)       Perth 34.0 (↓)       Hobart 34.8 (↓)       Darwin 35.1 (↓)       Canberra 28.5 (↓)       National 31.0 (↓)            AVERAGE DAYS TO SELL UNITS AND TREND         Sydney 25.8 (↓)       Melbourne 30.2 (↓)       Brisbane 27.6 (↓)       Adelaide 21.8 (↓)       Perth 37.8 (↓)       Hobart 25.2 (↓)       Darwin 24.8 (↓)       Canberra 41.1 (↓)       National 29.3 (↓)           
Share Button

M.B.A. Students vs. ChatGPT: Who Comes Up With More Innovative Ideas?

We put humans and AI to the test. The results weren’t even close.

By CHRISTIAN TERWIESCH
Thu, Sep 14, 2023 8:45amGrey Clock 4 min

How good is AI in generating new ideas?

The conventional wisdom has been not very good. Identifying opportunities for new ventures, generating a solution for an unmet need, or naming a new company are unstructured tasks that seem ill-suited for algorithms. Yet recent advances in AI, and specifically the advent of large language models like ChatGPT, are challenging these assumptions.

We have taught innovation, entrepreneurship and product design for many years. For the first assignment in our innovation courses at the Wharton School, we ask students to generate a dozen or so ideas for a new product or service. As a result, we have heard several thousand new venture ideas pitched by undergraduate students, M.B.A. students and seasoned executives. Some of these ideas are awesome, some are awful, and, as you would expect, most are somewhere in the middle.

The library of ideas, though, allowed us to set up a simple competition to judge who is better at generating innovative ideas: the human or the machine.

In this competition, which we ran together with our colleagues Lennart Meincke and Karan Girotra, humanity was represented by a pool of 200 randomly selected ideas from our Wharton students. The machines were represented by ChatGPT4, which we instructed to generate 100 ideas with otherwise identical instructions as given to the students: “generate an idea for a new product or service appealing to college students that could be made available for $50 or less.”

In addition to this vanilla prompt, we also asked ChatGPT for another 100 ideas after providing a handful of examples of successful ideas from past courses (in other words, a trained GPT group), providing us with a total sample of 400 ideas.

Collapsible laundry hamper, dorm-room chef kit, ergonomic cushion for hard classroom seats, and hundreds more ideas miraculously spewed from a laptop.

How to compare

The academic literature on ideation postulates three dimensions of creative performance: the quantity of ideas, the average quality of ideas, and the number of truly exceptional ideas.

First, on the number of ideas per unit of time: Not surprisingly, ChatGPT easily outperforms us humans on that dimension. Generating 200 ideas the old-fashioned way requires days of human work, while ChatGPT can spit out 200 ideas with about an hour of supervision.

Next, to assess the quality of the ideas, we market tested them. Specifically, we took each of the 400 ideas and put them in front of a survey panel of customers in the target market via an online purchase-intent survey. The question we asked was: “How likely would you be to purchase based on this concept if it were available to you?” The possible responses ranged from definitely wouldn’t purchase to definitely would purchase.

The responses can be translated into a purchase probability using simple market-research techniques. The average purchase probability of a human-generated idea was 40%, that of vanilla GPT-4 was 47%, and that of GPT-4 seeded with good ideas was 49%. In short, ChatGPT isn’t only faster but also on average better at idea generation.

Still, when you’re looking for great ideas, averages can be misleading. In innovation, it’s the exceptional ideas that matter: Most managers would prefer one idea that is brilliant and nine ideas that are flops over 10 decent ideas, even if the average quality of the latter option might be higher. To capture this perspective, we investigated only the subset of the best ideas in our pool—specifically the top 10%. Of these 40 ideas, five were generated by students and 35 were created by ChatGPT (15 from the vanilla ChatGPT set and 20 from the pre trained ChatGPT set). Once again, ChatGPT came out on top.

What it means

We believe that the 35-to-5 victory of the machine in generating exceptional ideas (not to mention the dramatically lower production costs) has substantial implications for how we think about creativity and innovation.

First, generative AI has brought a new source of ideas to the world. Not using this source would be a sin. It doesn’t matter if you are working on a pitch for your local business-plan competition or if you are seeking a cure for cancer—every innovator should develop the habit of complementing his or her own ideas with the ones created by technology. Ideation will always have an element of randomness to it, and so we cannot guarantee that your idea will get an A+, but there is no excuse left if you get a C.

Second, the bottleneck for the early phases of the innovation process in organisations now shifts from generating ideas to evaluating ideas. Using a large language model, an innovator can produce a spreadsheet articulating hundreds of ideas, which likely include a few blockbusters. This abundance then demands an effective selection mechanism to find the needles in the haystack.

To date, these models appear to perform no better than any single expert in their ability to predict commercial viability. Using a sample of a dozen or so independent evaluations from potential customers in the target market—a wisdom of crowds approach—remains the best strategy. Fortunately, screening ideas using a purchase intent survey of customers in the target market is relatively fast and cheap.

Finally, rather than thinking about a competition between humans and machines, we should find a way in which the two work together. This approach in which AI takes on the role of a co-pilot has already emerged in software development. For example, our human (pilot) innovator might identify an open problem. The AI (co-pilot) might then report what is known about the problem, followed by an effort in which the human and AI independently explore possible solutions, virtually guaranteeing a thorough consideration of opportunities.

The human decision maker is likely ultimately responsible for the outcome, and so will likely make the screening and selection decisions, informed by customer research and possibly by the opinion of the AI co-pilot. We predict such a human-machine collaboration will deliver better products and services to the market, and improved solutions for whatever society needs in the future.

Christian Terwiesch and Karl Ulrich are professors of operations, information and decisions at the Wharton School of the University of Pennsylvania, where Terwiesch also co-directs the Mack Institute for Innovation Management.



MOST POPULAR

Consumers are going to gravitate toward applications powered by the buzzy new technology, analyst Michael Wolf predicts

Chris Dixon, a partner who led the charge, says he has a ‘very long-term horizon’

Related Stories
Money
The Great Wealth Transfer: How rich millennials will invest the billions coming their way
By Bronwyn Allen 01/03/2024
Money
Japan Is Back. Is Inflation the Reason?
By GREG IP 01/03/2024
Money
Welcome to the Era of BadGPTs
By BELLE LIN 29/02/2024
The Great Wealth Transfer: How rich millennials will invest the billions coming their way

The younger generation will bring a different mindset to how and where their newfound wealth is invested

By Bronwyn Allen
Fri, Mar 1, 2024 2 min

There is an enormous global wealth transfer in its beginning stages, whereby one of the largest generations in history – the baby boomers – will pass on their wealth to their millennial children. Knight Frank’s global research report, The Wealth Report 2024, estimates the wealth transfer set to take place over the next two decades in the United States alone will amount to US$90 trillion.

But it’s not just the size of the wealth transfer that is significant. It will also deliver billions of dollars in private capital into the hands of investors with a very different mindset.

Seismic change

Wealth managers say the young and rich have a higher social and environmental consciousness than older generations. After growing up in a world where economic inequality is rife and climate change has caused massive environmental damage, they are seeing their inherited wealth as a means of doing good.

Ben Whattam, co-founder of the Modern Affluence Exchange, describes it as a “seismic change”.

“Since World War II, Western economies have been driven by an overt focus on economic prosperity,” he says. “This has come at the expense of environmental prosperity and has arguably imposed social costs. The next generation is poised to inherit huge sums, and all the research we have commissioned confirms that they value societal and environmental wellbeing alongside economic gain and are unlikely to continue the relentless pursuit of growth at all costs.”

Investing with purpose

Mr Whattam said 66% of millennials wanted to invest with a purpose compared to 49% of Gen Xers. “Climate change is the number one concern for Gen Z and whether they’re rich or just affluent, they see it as their generational responsibility to fix what has been broken by their elders.”

Mike Pickett, director of Cazenove Capital, said millennial investors were less inclined to let a wealth manager make all the decisions.

“Overall, … there is a sense of the next generation wanting to be involved and engaged in the process of how their wealth is managed – for a firm to invest their money with them instead of for them,” he said.

Mr Pickett said another significant difference between millennials and older clients was their view on residential property investment. While property has generated immense wealth for baby boomers, particularly in Australia, younger investors did not necessarily see it as the best path.

“In particular, the low interest rate environment and impressive growth in house prices of the past 15 years is unlikely to be repeated in the next 15,” he said. “I also think there is some evidence that Gen Z may be happier to rent property or lease assets such as cars, and to adopt subscription-led lifestyles.”

Impact investing is a rising trend around the world, with more young entrepreneurs and activist investors proactively campaigning for change in the older companies they are invested in. Millennials are taking note of Gen X examples of entrepreneurs trying to force change. In 2022,  Australian billionaire tech mogul and major AGL shareholder, Mike Cannon-Brookes tried to buy the company so he could shut down its coal operations and turn it into a renewable energy giant. He described his takeover bid as “the world’s biggest decarbonisation project”.

MOST POPULAR

Consumers are going to gravitate toward applications powered by the buzzy new technology, analyst Michael Wolf predicts

Chris Dixon, a partner who led the charge, says he has a ‘very long-term horizon’

Related Stories
Property
The ‘single biggest factor’ driving the rise in first homebuyer activity for Australians
By Bronwyn Allen 16/01/2024
Lifestyle
Going warm and fuzzy for the 2024 Pantone Colour of the Year
By KANEBRIDGE NEWS 08/12/2023
Money
Covid Slashed Consumer Choices. This Is Why They Aren’t Coming Back.
By PAUL BERGER 02/01/2024
0
    Your Cart
    Your cart is emptyReturn to Shop