Hi
2011/11/23 Gabor Juhos <juhosg@openwrt.org>:
> Hi René,
>
>> I don't know on which board you tested the patches,
>
> The patches were tested on an Ubiquiti Bullet 5M (AR7240), on a
> TP-Link TL-MR3420 (AR7241), and on an Atheros PB44 (AR7161) boards.
> You can find the bootlog of the Bullet 5M here:
> http://pastebin.com/p3UiU29M
>
>> but the pci read/write function are now broken.
>
> Here is a snippet from the original pci_read function:
>
> switch (size) {
> case 1:
> addr = where & ~3;
> mask = 0xff000000 >> ((where % 4) * 8);
> tval = reg_read(ATH724X_PCI_DEV_BASE + addr);
> tval = tval & ~mask;
> *value = (tval >> ((4 - (where % 4))*8));
> break;
>
> Say, we want to read four values from where={0,1,2,3} and with size=1.
> Because 'addr' will be zero, we will read the same 32 bits wide register
> in all cases, so I'm using 'tval = 0x12345678' for simplicity.
>
> if where == 0:
>
> mask = 0xff000000 >> ((0 % 4) * 8) = 0xff000000 >> (0 * 8) = 0xff000000 >> 0
> = 0xff000000
> tval = 0x12345678 & ~0xff000000 = 0x12345678 & 0x00ffffff = 0x00345678
> *value = 0x00345678 >> ((4 - (0 % 4 )) * 8) = 0x00345678 >> ((4 - 0) * 8) =
> 0x00345678 >> (4 * 8) = 0x00345678 >> 32 = 0x00000000
>
> Because shift is 32, the CPU will do nothing with the value, so it will
> return '0x00345678'. The value should be '0x78'.
>
> if where == 1:
>
> mask = 0xff000000 >> ((1 % 4) * 8) = 0xff000000 >> (1 * 8) = 0xff000000 >> 8
> = 0x00ff0000
> tval = 0x12345678 & ~0x00ff0000 = 0x12345678 & 0xff00ffff = 0x12005678
> *value = 0x12005678 >> ((4 - (1 % 4 )) * 8) = 0x12005678 >> ((4 - 1) * 8) =
> 0x12005678 >> (3 * 8) = 0x12005678 >> 24 = 0x00000012
>
> The value should be '0x56' instead of '0x00000012'.
>
> if where = 2:
>
> mask = 0xff000000 >> ((2 % 4) * 8) = 0xff000000 >> (2 * 8) = 0xff000000 >> 16
> = 0x0000ff00
> tval = 0x12345678 & ~0x0000ff00 = 0x12345678 & 0xffff00ff = 0x12340078
> *value = 0x12340078 >> ((4 - (2 % 4 )) * 8) = 0x12340078 >> ((4 - 2) * 8) =
> 0x12340078 >> (2 * 8) = 0x12340078 >> 16 = 0x00001234
>
> The value should be '0x34' instead of '0x00001234'.
>
> if where = 3:
>
> mask = 0xff000000 >> ((3 % 4) * 8) = 0xff000000 >> (3 * 8) = 0xff000000 >> 24
> = 0x000000ff
> tval = 0x12345678 & ~0x000000ff = 0x12345678 & 0xffffff00 = 0x12345600
> *value = 0x12345600 >> ((4 - (3 % 4 )) * 8) = 0x12345600 >> ((4 - 3) * 8) =
> 0x12345600 >> (1 * 8) = 0x12345600 >> 8 = 0x00123456
>
> The value should be '0x12' instead of '0x00123456'.
>
> Due to this, and the other errors in the pci_write functions,
> Linux fails to assign the correct IRQ number for the device.
> It can be noticed from the output of 'lspci -vv':
>
> Interrupt: pin A routed to IRQ 0
> vs
> Interrupt: pin A routed to IRQ 48
>
> I can show you the errors in the write functions, if you would
> like to see that as well.
>
>
> I'm curious why do you think that it is broken now.
> You are getting a data bus error by any chance?
>
after a pci write, the pci read return bogus values.
However, I go through this tomorrow.
>> -My patchset has the ability to use different irqs (see pci_data).
>
> Yes, I know. You can set that from the board setup by calling the
> {ath,ar}724x_pci_add_data function.
>
> However that approach has some limitations:
>
> 1. It does not supports assigning a different IRQ for the different
> interrupt pins (A,B,C,D) of a PCI device. This is not a problem on the
> AR724X boards, but that functionality is needed by some AR71xx based
> boards.
>
> 2. The devfn field of the struct pci_device is 0 on the AR724X based boards.
> However on AR71XX they are different. On the PB44 board, the devfn of a PCI
> device in the first miniPCI slot is 136, and it is 144 for the second slot.
> So if I want to define the pci_data for the PB44 board, I should write
> something like this:
>
> static struct ath724x_pci_data pb44_pci_data[] = {
> [136] = { .irq = PCI_IRQ_A },
> [144] = { .irq = PCI_IRQ_B },
> };
>
> The array has 136+8 unused entries, which wastes the memory.
>
> 3. The {ath,ar}724x_pci_add_data function must be called from the
> setup code of each board. If the board setup code does not calls the
> function, the kernel will throw an oops due to a NULL pointer dereference.
>
>> int __init pcibios_map_irq(const struct pci_dev *dev, uint8_t slot, uint8_t
>> pin)
>> {
>> unsigned int devfn = dev->devfn;
>> int irq = -1;
>>
>
> If the '{ath,ar}724x_pci_add_data' function is not called, pci_data_size = 0,
> and pci_data = NULL;
>
>> if (devfn > pci_data_size - 1)
>> return irq;
>
> devfn is always >= 0, and (pci_data_size - 1) = -1 = 0xffffffff, so the
> condition in this if statement will be evaluated to false ...
>
>> irq = pci_data[devfn].irq;
>
> ... and this line will cause the following oops:
>
> CPU 0 Unable to handle kernel paging request at virtual address 00000000, epc
> == 803c4cc8, ra == 803c4ca4
> Oops[#1]:
> Cpu 0
> $ 0 : 00000000 80510000 00000000 00000000
> $ 4 : 803b4128 00000a52 ffffffff 0000000a
> $ 8 : 0000000a 00000000 00000001 00000000
> $12 : 00000374 0000000f 00000001 ffffffff
> $16 : 00000000 80510000 803c4c74 8019d838
> $20 : 803d3fe0 00000000 00000000 00000000
> $24 : 00000002 800617f0
> $28 : 81c20000 81c21e50 00000000 803c4ca4
> Hi : 00000000
> Lo : 068e7780
> epc : 803c4cc8 pcibios_map_irq+0x54/0x6c
> Not tainted
> ra : 803c4ca4 pcibios_map_irq+0x30/0x6c
> Status: 1000c003 KERNEL EXL IE
> Cause : 00800008
> BadVA : 00000000
> PrId : 00019374 (MIPS 24Kc)
> Modules linked in:
> Process swapper (pid: 1, threadinfo=81c20000, task=81c18000, tls=00000000)
> Stack : 81c21e58 00000000 ffffffff 00000001 00000000 81c14c00 00000001
> 803d1840
> 00000000 80300ce8 803d2a7c 00000000 01000000 803d2af8 81c46800 00000000
> 803e9584 00000000 80510000 803d404c 00000000 00000000 80510000 803e9584
> 80510000 80060930 33390000 00000000 0000a498 80143058 00000028 803b0000
> 00000000 800bc4e4 803e92d0 803e9394 803e9584 00000000 00000000 00000000
> ...
> Call Trace:
> [<803c4cc8>] pcibios_map_irq+0x54/0x6c
> [<803d1840>] pci_fixup_irqs+0x78/0xc4
> [<803d404c>] pcibios_init+0x6c/0x8c
> [<80060930>] do_one_initcall+0x3c/0x1cc
> [<803c297c>] kernel_init+0xa4/0x138
> [<80063c44>] kernel_thread_helper+0x10/0x18
>
> Code: 8c4250b4 001080c0 00508021 <8e020000> 8fbf001c 8fb10018 8fb00014
> 03e00008 27bd0020
>
>>
>> return irq;
>> }
Ok
>> -I never hit the pci controller bug, any steps to replicate?
>
> Hm, weird. Your devices are based on AR7240 or or AR7241?
>
> Regards,
> Gabor
>
AR7241 AH-4A
Maybe it is better to split ar71xx and ar72xx pci support completly?
|