[issues] PCIe SSD with NVMe - Performance degradation
Posted: 2017/04/08 16:01:28
Hi folks.
I have a curious story that's been tormenting me for days.
Can someone give me some light???
I installed the SSD on a PowerEdge 1950 server and I have performance issues! For writing only! Reading is going well. I have operations that take about 2s (attachment) !!!
I use the disk in a cache partition on an nginx server.
CentOS release 6.8 (Final)
Server: PowerEdge 1950
Disk: Toshiba OCZ RD400A M.2 2280 + AIC 256GB PCI-Express 3.0 x 4 MLC Internal Solid State Drive (SSD) RVD400-22280-256G-A
dmesg:
Nvme 0000: 0a: 00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
Nvme 0000: 0a: 00.0: setting latency timer to 64
Ata_piix 0000: 00: 1f.1: version 2.13
Ata_piix 0000: 00: 1f.1: PCI INT A -> GSI 16 (level, low) -> IRQ 16
Ata_piix 0000: 00: 1f.1: setting latency timer to 64
Scsi1: ata_piix
Scsi2: ata_piix
Ata1: PATA max UDMA / 100 cmd 0x1f0 ctl 0x3f6 bmdma 0xfc00 irq 14
Ata2: PATA max UDMA / 100 cmd 0x170 ctl 0x376 bmdma 0xfc08 irq 15
Ata2: port disabled. Ignoring.
IRQ 16 / nvme0q0: IRQF_DISABLED is not guaranteed on shared IRQs
Alloc irq_desc for 31 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 31 for MSI / MSI-X
Alloc irq_desc for 32 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 32 for MSI / MSI-X
Alloc irq_desc for 33 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 33 for MSI / MSI-X
Alloc irq_desc for 34 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 34 for MSI / MSI-X
Alloc irq_desc for 35 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 35 for MSI / MSI-X
Alloc irq_desc for 36 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 36 for MSI / MSI-X
Alloc irq_desc for 37 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 37 for MSI / MSI-X
IRQ 31 / nvme0q0: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 31 / nvme0q1: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 32 / nvme0q2: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 33 / nvme0q3: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 34 / nvme0q4: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 35 / nvme0q5: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 36 / nvme0q6: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 37 / nvme0q7: IRQF_DISABLED is not guaranteed on shared IRQs
Nvme0n1: p1
I have a curious story that's been tormenting me for days.
Can someone give me some light???
I installed the SSD on a PowerEdge 1950 server and I have performance issues! For writing only! Reading is going well. I have operations that take about 2s (attachment) !!!
I use the disk in a cache partition on an nginx server.
CentOS release 6.8 (Final)
Server: PowerEdge 1950
Disk: Toshiba OCZ RD400A M.2 2280 + AIC 256GB PCI-Express 3.0 x 4 MLC Internal Solid State Drive (SSD) RVD400-22280-256G-A
dmesg:
Nvme 0000: 0a: 00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
Nvme 0000: 0a: 00.0: setting latency timer to 64
Ata_piix 0000: 00: 1f.1: version 2.13
Ata_piix 0000: 00: 1f.1: PCI INT A -> GSI 16 (level, low) -> IRQ 16
Ata_piix 0000: 00: 1f.1: setting latency timer to 64
Scsi1: ata_piix
Scsi2: ata_piix
Ata1: PATA max UDMA / 100 cmd 0x1f0 ctl 0x3f6 bmdma 0xfc00 irq 14
Ata2: PATA max UDMA / 100 cmd 0x170 ctl 0x376 bmdma 0xfc08 irq 15
Ata2: port disabled. Ignoring.
IRQ 16 / nvme0q0: IRQF_DISABLED is not guaranteed on shared IRQs
Alloc irq_desc for 31 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 31 for MSI / MSI-X
Alloc irq_desc for 32 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 32 for MSI / MSI-X
Alloc irq_desc for 33 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 33 for MSI / MSI-X
Alloc irq_desc for 34 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 34 for MSI / MSI-X
Alloc irq_desc for 35 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 35 for MSI / MSI-X
Alloc irq_desc for 36 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 36 for MSI / MSI-X
Alloc irq_desc for 37 on node -1
Alloc kstat_irqs on node -1
Nvme 0000: 0a: 00.0: irq 37 for MSI / MSI-X
IRQ 31 / nvme0q0: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 31 / nvme0q1: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 32 / nvme0q2: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 33 / nvme0q3: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 34 / nvme0q4: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 35 / nvme0q5: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 36 / nvme0q6: IRQF_DISABLED is not guaranteed on shared IRQs
IRQ 37 / nvme0q7: IRQF_DISABLED is not guaranteed on shared IRQs
Nvme0n1: p1