Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

leman

macrumors Core
Oct 14, 2008
19,319
19,336
I don't consider any PC to be "AI-enabled" unless it can run a model as good as GPT-4 locally at a similar token/s to ChatGPT. It's my own personal requirement.

So probably 2-3 more years.

Unlikely. RAM bandwidth just won’t be there. Maybe a heavily quantized model.
 

senttoschool

macrumors 68030
Nov 2, 2017
2,577
5,340
Unlikely. RAM bandwidth just won’t be there. Maybe a heavily quantized model.
In 2-3 years, I'm guessing that a computer using a chip in the class of a M6 Pro should be able to run it. The software side is moving really fast and small (7B) models are approaching GPT3.5 in output quality.

2-3 more years of software and hardware optimization should get us to GPT4 level locally for a M Pro class of devices. I'm betting that all chip makers are completely focused on improving the NPU/GPU for the next 2-3 generations of chips.
 

MayaUser

macrumors 68030
Nov 22, 2021
2,895
6,227
QC now have to start worrying about M4.

dont worry, we will get a new chart from them comparing with the M4, maybe they will invent some numbers for the upcoming M5
 
Last edited:
  • Like
Reactions: Homy

rampancy

macrumors 6502a
Jul 22, 2002
683
917
I'm sure we'll expect all of the usual folks (especially the ones on YouTube) saying that Tim Cook is entirely responsible for this, that Apple is doomed, the X Elite is going to better than the M4, M5 and M6 combined, and that all of our Apple Silicon machines are now instantly junk, so we all have to toss them in the bin right now and get Surface Pro X's instead.
 

donth8

macrumors regular
Sep 25, 2015
103
108

Attachments

  • IMG_3864.png
    IMG_3864.png
    237.5 KB · Views: 26
  • Like
Reactions: Xiao_Xi and Homy

MayaUser

macrumors 68030
Nov 22, 2021
2,895
6,227
If thats true....Qualcomm has left the building and we will not get from them a chart Elite vs M4
 
  • Like
Reactions: Homy

jido

macrumors 6502
Oct 11, 2010
274
132
I think that M4 score is skewed because Geekbench is using the wrong metric for “object detection”… score is just too high.
 

leman

macrumors Core
Oct 14, 2008
19,319
19,336
I think that M4 score is skewed because Geekbench is using the wrong metric for “object detection”… score is just too high.

It's not a wrong metric. Apple has finally opened up their matrix coprocessor to user software and GB6 can take advantage of that. It does push the score higher, but even if you remove that subtest you still have 10-20% better scores on average than M3 in the majority of subtests.
 

leman

macrumors Core
Oct 14, 2008
19,319
19,336
How can user software access the matrix coprocessor without any modification?

The software obviously needs to support the extensions. Presence of specific functionality (like SME) can be detected at runtime, at which point the software can invoke an optimized routine.

Note: I am unsure how this is actually done in practice. On Apple platforms, one can use sysctl family of functions. I imagine that there is also a CPU control register that allows one to check for a feature, but I was unable to figure this out with a cursory search.
 

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,532
955
On Apple platforms, one can use sysctl family of functions. I imagine that there is also a CPU control register that allows one to check for a feature, but I was unable to figure this out with a cursory search.
Maybe FEAT_SME?

Previous SoCs don't have it.

The software obviously needs to support the extensions. Presence of specific functionality (like SME) can be detected at runtime, at which point the software can invoke an optimized routine.
It is quite timely that the latest version of Geekbench has introduced support for Arm Scalable Matrix Extensions (SME) instructions.
 
  • Like
Reactions: tenthousandthings

leman

macrumors Core
Oct 14, 2008
19,319
19,336
Maybe FEAT_SME?

That's the one.

It is quite timely that the latest version of Geekbench has introduced support for Arm Scalable Matrix Extensions (SME) instructions.

Right? It is quite interesting, especially given the fact that no other ARM architecture (including ARM's upcoming Neoverse server cores) support SME.
 
  • Like
Reactions: cbum

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,532
955
It looks like a bunch of interesting internal Dell documents have been leaked.
The company claims that Snapdragon-based laptops will deliver 16.8 to 29.9 hours, depending on the screen type. To be precise, the FHD+ option at 29.6 hrs, QHD at 21.9 hrs, and OLED at 16.8 hrs.
Based on the 2023 estimates, Dell XPS with 10-core Nuvia (Snapdragon X Plus) would cost 145 USD, while the predecessor based on Core i7-1360P was valued at 293 USD.
Unfortunately, there is no information on the expected performance of Qualcomm's SoC.

 

crazy dave

macrumors 65816
Sep 9, 2010
1,302
1,002
It looks like a bunch of interesting internal Dell documents have been leaked.


Unfortunately, there is no information on the expected performance of Qualcomm's SoC.

1715617050092-png.29392



This slide is all kinds of hilarious - the target customer is such corporate speak. I'm sure Apple has similar internal target customer descriptions that would be equal parts hilarious and horrifying to read. It's just funny to see it in black and white - what they think of us, you know beyond dollar signs.

Also, target market position as compared to the ... checks notes ... M2 Air and M1 Pro. Oh dear ... a little delayed getting out to market were we?
 

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,532
955
Chips and Cheess has attempted to describe the Oryon core through LLVM patches.

Code:
list<Predicate> UnsupportedFeatures = !listconcat(SVEUnsupported.F,
                                                    SMEUnsupported.F,
                                                    MTEUnsupported.F,
                                                    PAUnsupported.F,
                                                    [HasPAuth, HasCSSC]);

Code:
ARMCPUTestParams<AArch64::ExtensionBitset>(
            "oryon-1", "armv8.6-a", "crypto-neon-fp-armv8",
            (AArch64::ExtensionBitset(
                {AArch64::AEK_CRC,     AArch64::AEK_FP,      AArch64::AEK_PAUTH,
                 AArch64::AEK_FCMA,    AArch64::AEK_JSCVT,   AArch64::AEK_SIMD,
                 AArch64::AEK_RAS,     AArch64::AEK_LSE,     AArch64::AEK_RDM,
                 AArch64::AEK_RCPC,    AArch64::AEK_DOTPROD, AArch64::AEK_SM4,
                 AArch64::AEK_SHA3,    AArch64::AEK_BF16,    AArch64::AEK_SHA2,
                 AArch64::AEK_AES,     AArch64::AEK_I8MM,    AArch64::AEK_RAND,
                 AArch64::AEK_PROFILE, AArch64::AEK_CRYPTO})),
            "8.6-A")),
 
Last edited:

deconstruct60

macrumors G5
Mar 10, 2009
12,370
3,939
Right? It is quite interesting, especially given the fact that no other ARM architecture (including ARM's upcoming Neoverse server cores) support SME.

Merged SME support back in 2022

and 2023

relatively limited footprint benchmarks like GB , SPEC , etc get run is processor design simulations.

Arm is not openly talking about Neoverse v4 but that doesn't mean it isn't being worked on. Neoverse v3 has SVE2. Kind of makes sense to roll that out first since it is a precursor SME.
 

deconstruct60

macrumors G5
Mar 10, 2009
12,370
3,939
Chips and Cheess has attempted to describe the Oryon core through LLVM patches.

Code:
list<Predicate> UnsupportedFeatures = !listconcat(SVEUnsupported.F,
                                                    SMEUnsupported.F,
                                                    MTEUnsupported.F,
                                                    PAUnsupported.F,
                                                    [HasPAuth, HasCSSC]);

Code:
ARMCPUTestParams<AArch64::ExtensionBitset>(
            "oryon-1", "armv8.6-a", "crypto-neon-fp-armv8",
            (AArch64::ExtensionBitset(
                {AArch64::AEK_CRC,     AArch64::AEK_FP,      AArch64::AEK_PAUTH,
                 AArch64::AEK_FCMA,    AArch64::AEK_JSCVT,   AArch64::AEK_SIMD,
                 AArch64::AEK_RAS,     AArch64::AEK_LSE,     AArch64::AEK_RDM,
                 AArch64::AEK_RCPC,    AArch64::AEK_DOTPROD, AArch64::AEK_SM4,
                 AArch64::AEK_SHA3,    AArch64::AEK_BF16,    AArch64::AEK_SHA2,
                 AArch64::AEK_AES,     AArch64::AEK_I8MM,    AArch64::AEK_RAND,
                 AArch64::AEK_PROFILE, AArch64::AEK_CRYPTO})),
            "8.6-A")),


SME is Arm v9 ... Given Qualcomm/Nuvia and Arm have been suing each other over that last couple of years how likely are Qualcomm going to be up to date on licensing?
That they are v8 is a surprise?

Nuvia was somewhat aiming at Neoverse v1/n1 maybe v2. BF16 would be a bigger deal back in the v1/n1 era.
 

Xiao_Xi

macrumors 68000
Oct 27, 2021
1,532
955
Microsoft will be making a presentation on Windows on Arm this week.
 

deconstruct60

macrumors G5
Mar 10, 2009
12,370
3,939
Microsoft will be making a presentation on Windows on Arm this week.

Pretty good chance that is more so "more complete dev tools parity with x86-64" than something unique to Windows on Arm. ( both speakers do 'dev tool product' work so probably will talk mostly about what they do for their 'day job'. )



Microsoft has their own NPU access abstraction to use that makes it easier to port to a variety of NPUs; not just Qualcomm's.
 
  • Like
Reactions: Xiao_Xi

deconstruct60

macrumors G5
Mar 10, 2009
12,370
3,939
1715617050092-png.29392



This slide is all kinds of hilarious - the target customer is such corporate speak.

'Marketing' and 'Sales' are not the same thing. Marketing more so should be about finding the mapping of customer needs to the products the company does or does not provide. So it isn't 'corporate speak'. It is the job of marketing to find the target markets. Don't have to be a large corporation to have a need to do marketing.

Dell has nine laptop product lines. ( XPS , Lattitue , Inspiron , Alienware , G Series , Precision , Lattitute Rugged , Dell Edu , Chromebooks Enterprise. ) .





An equally large increase over what Apple does for the number of desktop product lines.

XPS plus with non-physical function keys really isn't aimed as much at 'business users ' as it might have been 5-8 years ago.


That said, the more telling number there is the 241K Unit projection over 18 months. I doubt Apple would even 'green light' a laptop with that low a number. Apple is going to herd more customers into smaller number of categories to get better economies of scale. Dell gets some scale by just outsourcing some of their laptop options (and substantively get shared costs by sharing lots of design costs over mulitple vendors with reused design components and more 'badging' on the outer case over shared internals. ) .

Dell is perhaps a little misguided if they think Apple has the same labels they do. Pretty likely though they actually think they are coming at the "MBA and MBP " larger bucket with more than just one product. All of those other products aren't on this one slide.


I'm sure Apple has similar internal target customer descriptions that would be equal parts hilarious and horrifying to read. It's just funny to see it in black and white - what they think of us, you know beyond dollar signs.

There are user surveys when submit warranty/registration info. It doesn't necessarily have to be a "think you are" as opposed to something for more data driven, but simplified into a 'one liner'.


[ None of these 'target markets' are 100% perfectally segmented. Some business folks will buy XPS and some socail media folks will buy something outside the XPS category . Highly doubtful neither Dell or Apple or anyone else with a decent marketing dept thinks they have 100% homogenous filling of categories. ]




Also, target market position as compared to the ... checks notes ... M2 Air and M1 Pro. Oh dear ... a little delayed getting out to market were we?

Leaked slides are often not the latest breifing material. People to want to protect their sources tend to sit on stuff for a signifant amount of time before relessing when the there will be much less interest in trying to trace back the source of the leak. There is nothing here about Core Ultra Meotor lake either.

Current page for the Dell doesn't even have a "Raptor Lake" ( 13000 series) XPS 13 on it .
https://www.dell.com/en-us/shop/scc/scr/laptops/xps/appref=37868

There is a XPS 15 and a more stale 1200 XPS , but the 1300 series is gone.

These are pretty likely some Q1-Q3 2023 era slides that are just now making it out into the 'public'. It is relatively immaterial there is no M3 on there.
 
Last edited:
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.