|
|
Mac Pro memory architecture questions
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
If you combine Intel's chipset docs ("The memory interface for the Intel 5000X MCH supports four memory channels with four Fully Buffered DIMMs per channel, enabling a total system memory bandwidth of up to 17 GB/second on a 64 GB total capacity.") with Apple's chipset diagram (below), it appears that the optimal configuration (for bandwdith) is to populate one FB-DIMM in each channel (which would be every other slot on both cards).
Is it even possible to only have a single FB-DIMM in each channel?
Is it correct to say that for maximum bandwidth you need at least one FB-DIMM in each of the four channels?
Since FB-DIMMs are chained in serial, rather than parallel like dual channel DDR, does having a second FB-DIMM in each channel help?
|
|
|
|
|
|
|
|
|
Moderator
Join Date: Apr 2000
Location: Gothenburg, Sweden
Status:
Offline
|
|
Do you mind linking those chipset docs? I was wondering that myself.
Apple eventually puts out a technote explaining details like this, but for now we'll have to make do with this quote:
Mac Pro uses 667MHz DDR2 fully buffered ECC memory, a new industry-standard memory technology that allows for more memory capacity, higher speeds, and better reliability. To take full advantage of the 256-bit wide memory architecture, four or more FB-DIMMs should be installed in Mac Pro.
It suggests that your assumptions are correct. I found it in the Applestore, in the "Learn More" text that shows up under Memory on the configure page for the Mac Pro.
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
Originally Posted by P
Do you mind linking those chipset docs? I was wondering that myself.
http://www.intel.com/design/chipsets...umentation.htm
I'm sure you have to fill all 4 channels for max performance. My only real question remaining is if you have to put a pair of FB-DIMMs in each channel, or if one is possible.
|
|
|
|
|
|
|
|
|
Fresh-Faced Recruit
Join Date: Aug 2006
Location: Corinth, Texas
Status:
Offline
|
|
Let us compare the Mac Pro's memory architecture with Dell's dual dual core (quad) boxes. The Mac Pro is 256 bits wide 667MHz DDR2 vs. Dell's what? If the Dell's don't match the I/O bandwidth of the Mac Pro, then the Mac Pro has a definitely superior architecture. Is Dell even using Woodcrests?
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
Originally Posted by OldRocketGuy
Let us compare the Mac Pro's memory architecture with Dell's dual dual core (quad) boxes. The Mac Pro is 256 bits wide 667MHz DDR2 vs. Dell's what? If the Dell's don't match the I/O bandwidth of the Mac Pro, then the Mac Pro has a definitely superior architecture. Is Dell even using Woodcrests?
Why bother comparing? They're identical except the Dell workstations have 16 slots on 4 channels instead of 8 slots on 4 channels, so you can have 64G in the Dell but only 32G in the Mac Pro.
Of course Dell is using Woodcrests. They've were shipping them before Apple even announced the Mac Pro.
Don't hijack my thread with your trolling.
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2001
Location: South of the Mason-Dixon line
Status:
Offline
|
|
Originally Posted by mduell
You can use a single (or 3) DIMM but you won't get the benefit of dual (um, 'multi-channel', rather) channel operation - on either bank if you use 3.
While I can't confirm this fact firsthand - my source for this information has never been wrong. She has a machine with the same specs that was running 3 DIMMs at one time.
(
Last edited by Spliffdaddy; Aug 8, 2006 at 08:21 PM.
)
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
Originally Posted by Spliffdaddy
You can use a single (or 3) DIMM but you won't get the benefit of dual (um, 'multi-channel', rather) channel operation - on either bank if you use 3.
While I can't confirm this fact firsthand - my source for this information has never been wrong. She has a machine with the same specs that was running 3 DIMMs at one time.
That's how it was with DDR/DDR2 DIMMs. With FB-DIMMs you have channels made up of modules, rather than banks made up of channels (or Intel just decided to switch terminology on me). The FB-DIMMs are chained in serial within a channel, and the channels run in parallel; thus 4 channels with 64-bit wide modules makes a 256-bit wide memory bus. I could be totally wrong and confused, but what you're saying doesn't jive with what I've read.
Does your source actually have a Xeon 51xx setup with FB-DIMMs? How were the 3 FB-DIMMs arranged? All 3 in one channel, 2 in one channel 1 in another, or all 3 in different channels?
|
|
|
|
|
|
|
|
|
Dedicated MacNNer
Join Date: Dec 2003
Status:
Offline
|
|
hope this doesnt break any rules
|
|
|
|
|
|
|
|
|
Mac Elite
Join Date: Mar 2006
Location: Here
Status:
Offline
|
|
I wonder if it will work in quad channel with different amounts of RAM in each channel. I'd bet it would, but I wonder.
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
Originally Posted by thetman
hope this doesnt break any rules
I'm probably does, but thanks!
I've talked to a few people who bought them; as soon as they get their hands on them, I'll ask them to play around with the memory setup and see what boots and what doesn't.
|
|
|
|
|
|
|
|
|
Moderator
Join Date: Apr 2000
Location: Gothenburg, Sweden
Status:
Offline
|
|
Apple did indeed release a technote on the memory expansion in the Mac Pros. It notes that bank 1 and 3 are on the same bus and bank 2 and 4 on the same bus. If you put that together with the picture thetman provided, it's obvoius that putting one DIMM on each bus is acceptable - of the four combinations, only the last one fills all the buses.
|
|
|
|
|
|
|
|
|
Professional Poster
Join Date: Jun 2006
Location: "Working"
Status:
Offline
|
|
Perhaps this is why Apple makes the 2GB option on the Pros 4x512MB instead of 2x1GB, that way the multi-channel advantages are realized.
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Nov 2000
Location: in front of my Mac
Status:
Offline
|
|
(
Last edited by Simon; Aug 9, 2006 at 05:58 PM.
)
|
•
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
Ah-ha, they played with the memory slot arrangement.
Only question left is if you need to fill both channels on a branch or not. IOW, will a Mac Pro boot with only one FB-DIMM?
I'm happy to see the optical drives remain ATA/100; SATA optical drives are available, but expensive and limited.
Also curious that they show the two exra SATA busses (the southbridge supports 6) terminating to no where... perhaps it's a hint that eSATA is coming soon.
Unfortunate that all four Firewire ports are bottlenecked over a single 133MBps PCI bus.
Any chance you could post the PCI Express section? I'm curious about the configurable bandwidth setup.
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Nov 2000
Location: in front of my Mac
Status:
Offline
|
|
Originally Posted by mduell
Also curious that they show the two exra SATA busses (the southbridge supports 6) terminating to no where... perhaps it's a hint that eSATA is coming soon.
I saw that too. eSATA would be very nice.
Any chance you could post the PCI Express section? I'm curious about the configurable bandwidth setup.
Not much there yet.
PCI Express Architecture
The Mac Pro has four internal, 2.5 GHz, PCI Express links connected to the North Bridge IC and South Bridge IC. The PCI Express slots are system and user configurable. The Mac Pro’s standard configuration is one 16-lane, double-wide graphics slot, two 4-lane expansion slots, and one 1-lane expansion slot.
|
•
|
|
|
|
|
|
|
|
Moderator
Join Date: May 2001
Location: Hilbert space
Status:
Offline
|
|
@Simon
You're cutting it close here, the diagram barely fits my browser window
|
I don't suffer from insanity, I enjoy every minute of it.
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Nov 2000
Location: in front of my Mac
Status:
Offline
|
|
Originally Posted by OreoCookie
@Simon
You're cutting it close here, the diagram barely fits my browser window
I'm sorry. I know I'm really pushing it.
That said, you need to get yourself a decent screen. On my 23" ACD the diagram fits about four times.
|
•
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Nov 2000
Location: in front of my Mac
Status:
Offline
|
|
Wait a moment. After all, there's imageshack...
Fixinated.
|
•
|
|
|
|
|
|
|
|
Moderator
Join Date: May 2001
Location: Hilbert space
Status:
Offline
|
|
Originally Posted by Simon
I'm sorry. I know I'm really pushing it.
That said, you need to get yourself a decent screen. On my 23" ACD the diagram fits about four times.
I have a MacBook Pro with plenty of screen estate. I just prefer small browser windows (lots and lots of windows!)
BTW, I don't want to be a pain, but please shorten your sig to four lines. Thanks
|
I don't suffer from insanity, I enjoy every minute of it.
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
Two 4x and a 1x? That's ridiculous. Even the PowerMacs had two 4x and an 8x.
The Intel southbridge has got to have more lanes available than that.
|
|
|
|
|
|
|
|
|
Mac Elite
Join Date: Jan 2003
Location: NYC
Status:
Offline
|
|
I thought I read somewhere that the PCIe controller had 40 lanes total; 16 for the video card and the rest configurable between the rest of the slots.
|
"I start fires!"
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
After doing a bit more reading, the memory performance deal is this: 4 FB-DIMMs is the optimum configuration; this maximizes memory bandwidth while minimizing latency. With 2 FB-DIMMs you get the same latency but half the bandwidth. With 6 or 8 FB-DIMMs you get the same bandwidth but higher (at least 3-5ns) latency.
I still don't know about having an odd numer of FB-DIMMs.
Originally Posted by MaxPower2k3
I thought I read somewhere that the PCIe controller had 40 lanes total; 16 for the video card and the rest configurable between the rest of the slots.
That was my guess, based on past chipsets. The Mac Pro actually has 44 PCIe lanes: 16 for the graphics slot, 8 on each the northbridge and southbridge to talk to each other, and 12 for the remaining 3 slots.
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Nov 2000
Location: in front of my Mac
Status:
Offline
|
|
Umm, actually you also lose one lane to the AP module. Apple gives these possibilities:
default: 16-1-4-4
optional: 8-8-1-8, 8-8-4-4, 16-1-1-8
16 (GPU) + 2x8 (NB-SB) + 1 (AP) + 10 (max in slots 2-4) = 43. Did they 'waste' a lane somewhere?
http://developer.apple.com/documenta...inkElementID_3
|
•
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
Weird... for some reason they don't support 2x slots at all.
|
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Nov 2000
Location: in front of my Mac
Status:
Offline
|
|
Yeah, I noticed that too.
|
•
|
|
|
|
|
|
|
|
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status:
Offline
|
|
Someone tested it, and yes, the Mac Pro will boot with an odd number of FB-DIMMs.
Thanks tobyg!
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Forum Rules
|
|
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
|
HTML code is Off
|
|
|
|
|
|
|
|
|
|
|
|