In this case I was referring to bandwidth and latency, which on-package memory helps with. It does make a difference in memory-intensive applications, but the majority of people would never notice a difference. Also Apple will absolutely give you a ton of memory, you just have to pay for it. They offer 128GB on the MacBook Pro, and it’s unified so the GPU has full access to it, which makes it surprisingly good for running LLMs locally, for example.
In this case I was referring to bandwidth and latency, which on-package memory helps with. It does make a difference in memory-intensive applications, but the majority of people would never notice a difference. Also Apple will absolutely give you a ton of memory, you just have to pay for it. They offer 128GB on the MacBook Pro, and it’s unified so the GPU has full access to it, which makes it surprisingly good for running LLMs locally, for example.