I Need More Hardware!
Posted by Tyler Muth on February 8, 2012
Actually, this is one of the few times I can remember in my career when I can honestly say I have enough horsepower at my disposal.
Want to guess what I’m running right now?
> select count(*) from v$asm_disk where name like 'DATA_XXX%';
COUNT(*)
----------
504
> select sum(total_mb)/1024/1024 tb from v$asm_disk;
TB
----------
272.15918
> select count(*) from gv$instance;
COUNT(*)
----------
6
[oracle@somehost: ~]$ cat /proc/meminfo | grep MemTotal
MemTotal: 1058429820 kB
[oracle@somehost: ~]$ cat /proc/cpuinfo | grep -m 1 Xeon
model name : Intel(R) Xeon(R) CPU X7560 @ 2.27GHz
[oracle@somehost: ~]$ cat /proc/cpuinfo | grep -c Xeon
128
[root@somehost ~]# find /sys/class/infiniband/ -name 'rate' -exec cat {} \;
40 Gb/sec (4X QDR)
40 Gb/sec (4X QDR)
40 Gb/sec (4X QDR)
40 Gb/sec (4X QDR)
40 Gb/sec (4X QDR)
40 Gb/sec (4X QDR)
40 Gb/sec (4X QDR)
40 Gb/sec (4X QDR)
This POV will probably generate a number of follow-up posts. One concept: there are always bottlenecks. When you remove the hardware bottlenecks, bottlenecks in your code quickly surface.
James "J.R." Myers said
But can it play M.U.L.E.?
Andy Colvin (@acolvin) said
3 X2-8 racks clustered together? sounds like fun!
Tyler Muth said
I figured it would be someone from enkitec to get it first. Running on a diskgroup that only spans 14 cells and mostly using 2 nodes as we’re trying to only test a single X2-8. It’s nice having the other 4 nodes of CPU power when you need it though.
Andy Colvin (@acolvin) said
It is a shame they didn’t give you one of the new ones with the core i7 cpus in there…probably didn’t spring for the new 3TB drives either, although they probably stick you with the high performance disks. They love those for the benchmarks, but all we seem to see in the field are the high performance disks. Everybody wants that extra 5x of disk space!
kevinclosson said
“core i7″ ?
Andy Colvin (@acolvin) said
getting late…meant the e7. Been a long week. Blame the patches…I know I will.
kevinclosson said
I *fully* understand what #Patchmadness can do to the mind… I knew you meant Xeon E7 … just more google search terms for Tyler
kevinclosson said
why Nehalem-EX instead of E7?
Actually, the bottleneck is going to be the glueless snoopy 2-hop NUMA in those x4800s. Do you have the Control Group ready code for the instances?