Full System Simulation with QEMU
A full-system simulation, which involves application/driver software code and FIM/AFU hardware logic, not only speeds up the development and debugging process of the SW/HW interface, but also enables the evaluation of this full-stack solution without a physical FPGA acceleration card.
Screen capture of successful OPAE driver scan results and dmesg:
Screen capture of OPAE driver behaviour on feature RAM in FIM:
First accelerator application utilizing DMA over PCIe runs successfully!
[ 98%] Linking C executable ../bin/hello_fpga
[ 99%] Built target hello_fpga
[100%] Built target object_api
[sudo] password for user:
Sorry, try again.
[sudo] password for user:
Using OPAE C library version '1.3.0' build 'unknown'
Running Test
token_list.c:243:token_get_parent() **ERROR** : can't find parent in: /sys/class/fpga/intel-fpga-dev.0/
Running on bus 0x00.
AFU_CDMACR@0x1000 = 0x0000
AFU_CDMASR@0x1004 = 0x1002
I buffer physical address 0x00000000aca00000
O buffer physical address 0x00000000ac800000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1000
AFU_CDMASR@0x1004 = 0x1002
Done Running Testinsmod drivers:
[ 64.749658] fpga_mgr_mod: loading out-of-tree module taints kernel.
[ 64.749688] fpga_mgr_mod: module verification failed: signature and/or required key missing - tainting kernel
[ 64.751114] FPGA manager framework
[ 64.758970] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1528: ccidrv_init
[ 64.758972] Intel(R) FPGA PCIe Driver: Version 0.14.0
[ 64.758974] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 84: fpga_ids_init
[ 64.758976] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 176: fpga_chardev_init
[ 64.759587] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1411: cci_pci_probe
[ 64.759641] intel-fpga-pci 0000:00:04.0: PCIE AER unavailable -5.
[ 64.760292] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1127: create_init_drvdata
[ 64.760673] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 102: alloc_fpga_id
[ 64.760676] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1352: cci_pci_alloc_irq
[ 64.760678] intel-fpga-pci 0000:00:04.0: fpga interrupt not supported
[ 64.760679] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1199: cci_pci_create_feature_devs
[ 64.760680] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 378: build_info_alloc_and_init
[ 64.760681] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1173: fpga_create_parent_dev
[ 64.761396] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 245: parse_start
[ 64.761398] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 233: parse_start_from
[ 64.761399] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 205: cci_pci_ioremap_bar
[ 64.761419] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1066: parse_feature_list
[ 64.761419] LOG: call_stack: parse_feature_list, for_loop
[ 64.761420] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1038: parse_feature
[ 64.761421] LOG: readq: header.csr = readq(hdr);
[ 68.230542] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 962: parse_feature_fiu
[ 68.230544] LOG: readq: header.csr = readq(hdr);
[ 68.272057] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 855: parse_feature_port
[ 68.272059] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 70: port_feature_num
[ 68.272061] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 440: build_info_create_dev
[ 68.272062] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 407: build_info_commit_dev
[ 68.278152] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 102: alloc_fpga_id
[ 68.278155] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 195: fpga_get_devt
[ 68.278158] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 48: feature_platform_data_alloc_and_init
[ 68.278159] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 40: feature_platform_data_size
[ 68.278160] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 734: create_feature_instance
[ 68.306429] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 551: build_info_add_sub_feature
[ 68.306433] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 27: feature_platform_data_add
[ 68.347484] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 870: enable_port_uafu
[ 68.347487] LOG: readq: capability.csr = readq(&port_hdr->capability);
[ 68.390018] LOG: readq: control.csr = readq(&port_hdr->control);
[ 68.436273] port_features[6].resource_size = 0x40000
[ 68.436276] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1842: fpga_port_reset
[ 68.436968] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1829: __fpga_port_reset
[ 68.436970] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 282: __fpga_port_disable
[ 68.436972] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 68.487259] LOG: readq: control.csr(0x0000000000000014) = readq(&port_hdr->control(0x0000000040000038));
[ 68.545706] LOG: writeq: writeq(control.csr(0x0000000000000015), &port_hdr->control(0x0000000040000038));
[ 68.545710] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 255: __fpga_port_enable
[ 68.545712] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 68.545713] LOG: readq: control.csr = readq(&port_hdr->control);
[ 68.594333] LOG: writeq: writeq(control.csr, &port_hdr->control);
[ 68.647778] LOG: readq: fiu_header.csr = readq(&fiu_hdr->csr);
[ 68.692636] intel-fpga-pci 0000:00:04.0: No AFUs detected on FIU 1
[ 68.692640] LOG: readq: header.csr = readq(hdr);
[ 68.746879] LOG: call_stack: parse_feature_list, for_loop
[ 68.746883] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1038: parse_feature
[ 68.746884] LOG: readq: header.csr = readq(hdr);
[ 68.897123] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 942: parse_feature_afu
[ 68.897125] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 390: feature_dev_id_type
[ 68.897128] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 923: parse_feature_port_afu
[ 68.897129] port_features[6].resource_size = 0x40000
[ 68.897130] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 734: create_feature_instance
[ 68.897131] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 551: build_info_add_sub_feature
[ 68.897133] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 27: feature_platform_data_add
[ 68.897134] LOG: readq: header.csr = readq(hdr);
[ 69.033487] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 1094: parse_ports_from_fme
[ 69.033491] intel-fpga-pci 0000:00:04.0: VF is detected.
[ 69.033494] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 407: build_info_commit_dev
[ 69.038540] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 390: feature_dev_id_type
[ 69.038543] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 124: cci_pci_add_port_dev
[ 69.038544] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/pcie.c: 528: build_info_free
[ 69.047754] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1292: afu_probe
[ 69.047758] intel-fpga-port intel-fpga-port.0: afu_probe
[ 69.047761] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1255: afu_dev_init
[ 69.047762] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1690: fpga_pdata_set_private
[ 69.047764] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/region.c: 19: afu_region_init
[ 69.047765] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 69.047766] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 32: afu_dma_region_init
[ 69.047767] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 69.047769] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 122: fpga_dev_feature_init
[ 69.047770] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 100: feature_instance_init
[ 69.047771] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 38: port_hdr_test
[ 69.047772] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.092711] LOG: readq: value(=0x0000000000000000) = readq(addr(=0x0000000040000020));
[ 69.092714] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.138246] LOG: readq: value(=0x0000000000000000) = readq(addr(=0x0000000040000028));
[ 69.138249] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.181050] LOG: readq: value(=0x0000000000010000) = readq(addr(=0x0000000040000030));
[ 69.181053] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.228350] LOG: readq: value(=0x0000000000000014) = readq(addr(=0x0000000040000038));
[ 69.228355] intel-fpga-port intel-fpga-port.0: hdr:control: incorrect value 0x14 vs defautl 0x4
[ 69.228358] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.267335] LOG: readq: value(=0x0000000000000000) = readq(addr(=0x0000000040000040));
[ 69.267339] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.308276] LOG: readq: value(=0x0000000000000000) = readq(addr(=0x0000000040000048));
[ 69.308280] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.347960] LOG: readq: value(=0x0000000000000000) = readq(addr(=0x0000000040000050));
[ 69.347964] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.386034] LOG: readq: value(=0x0000000000000000) = readq(addr(=0x0000000040000058));
[ 69.386038] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.427546] LOG: readq: value(=0x0000000000000000) = readq(addr(=0x0000000040000060));
[ 69.427551] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu-check.c: 6: port_check_reg
[ 69.471641] LOG: readq: value(=0x0000000000000000) = readq(addr(=0x0000000040000068));
[ 69.471648] intel-fpga-port intel-fpga-port.0: port_hdr_test finished
[ 69.471650] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 339: port_hdr_init
[ 69.471652] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 69.471653] intel-fpga-port intel-fpga-port.0: PORT HDR Init.
[ 69.471654] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1842: fpga_port_reset
[ 69.472871] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1829: __fpga_port_reset
[ 69.472874] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 282: __fpga_port_disable
[ 69.472875] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 69.514245] LOG: readq: control.csr(0x0000000000000014) = readq(&port_hdr->control(0x0000000040000038));
[ 69.568293] LOG: writeq: writeq(control.csr(0x0000000000000015), &port_hdr->control(0x0000000040000038));
[ 69.568297] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 255: __fpga_port_enable
[ 69.568298] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 69.568299] LOG: readq: control.csr = readq(&port_hdr->control);
[ 69.608370] LOG: writeq: writeq(control.csr, &port_hdr->control);
[ 69.670548] LOG: readq: header.csr = readq(&port_hdr->header);
[ 69.721011] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 100: feature_instance_init
[ 69.721015] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 440: port_afu_init
[ 69.721018] intel-fpga-port intel-fpga-port.0: PORT AFU Init.
[ 69.721020] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/region.c: 43: afu_region_add
[ 69.721022] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 69.721023] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/region.c: 30: get_region_by_index
[ 69.721027] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 205: fpga_register_dev_ops
execute application:
[ 77.211377] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 962: afu_open
[ 77.211379] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1855: fpga_inode_to_feature_dev
[ 77.211382] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1648: feature_dev_use_begin
[ 77.211386] intel-fpga-port intel-fpga-port.0: Device File Opened 1 Times
[ 77.211389] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1011: afu_release
[ 77.211391] intel-fpga-port intel-fpga-port.0: Device File Release
[ 77.211392] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1662: __feature_dev_use_end
[ 77.211394] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 375: fpga_msix_set_block
[ 77.211395] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 375: fpga_msix_set_block
[ 77.211397] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 711: afu_port_umsg_halt
[ 77.211398] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1873: is_feature_present
[ 77.211399] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 77.211400] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1829: __fpga_port_reset
[ 77.211401] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 282: __fpga_port_disable
[ 77.211402] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 77.253098] LOG: readq: control.csr(0x0000000000000014) = readq(&port_hdr->control(0x0000000040000038));
[ 77.304651] LOG: writeq: writeq(control.csr(0x0000000000000015), &port_hdr->control(0x0000000040000038));
[ 77.304655] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 255: __fpga_port_enable
[ 77.304657] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 77.304658] LOG: readq: control.csr = readq(&port_hdr->control);
[ 77.344226] LOG: writeq: writeq(control.csr, &port_hdr->control);
[ 77.395447] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 210: afu_dma_region_destroy
[ 77.395451] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 77.396144] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 408: afu_id_show
[ 77.396145] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 77.396146] LOG: readq: guidl = readq(&afu_hdr->guid.b[0]);
[ 77.530485] LOG: readq: guidh = readq(&afu_hdr->guid.b[8]);
[ 77.663657] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 962: afu_open
[ 77.663659] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1855: fpga_inode_to_feature_dev
[ 77.663660] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1629: feature_dev_use_excl_begin
[ 77.663665] intel-fpga-port intel-fpga-port.0: Device File Opened 1 Times
[ 77.663680] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1171: afu_ioctl
[ 77.663681] intel-fpga-port intel-fpga-port.0: afu_ioctl cmd 0xb542
[ 77.663683] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1090: afu_ioctl_get_region_info
[ 77.663684] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/region.c: 97: afu_get_region_by_index
[ 77.663685] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 77.663686] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/region.c: 30: get_region_by_index
[ 77.663695] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1214: afu_mmap
[ 77.663696] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/region.c: 119: afu_get_region_by_offset
[ 77.663697] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 77.663720] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1171: afu_ioctl
[ 77.663722] intel-fpga-port intel-fpga-port.0: afu_ioctl cmd 0xb543
[ 77.663723] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1121: afu_ioctl_dma_map
[ 77.663724] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 288: afu_dma_map_region
[ 77.663725] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 80: afu_dma_pin_pages
[ 77.663726] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 40: afu_dma_adjust_locked_vm
[ 77.663729] intel-fpga-port intel-fpga-port.0: [3153] RLIMIT_MEMLOCK +2097152 2097152/65536
[ 77.664000] intel-fpga-port intel-fpga-port.0: 512 pages pinned
[ 77.664002] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 133: afu_dma_check_continuous_pages
[ 77.664004] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1887: fpga_pdata_to_pcidev
[ 77.664005] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1880: fpga_feature_dev_to_pcidev
[ 77.664007] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 160: afu_dma_region_add
[ 77.664009] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 77.664010] intel-fpga-port intel-fpga-port.0: add region (iova = aca00000)
[ 77.664012] intel-fpga-port intel-fpga-port.0: dma map: ua=7f1de9400000, len=200000, iova=aca00000
[ 77.664024] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1171: afu_ioctl
[ 77.664026] intel-fpga-port intel-fpga-port.0: afu_ioctl cmd 0xb543
[ 77.664027] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1121: afu_ioctl_dma_map
[ 77.664028] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 288: afu_dma_map_region
[ 77.664029] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 80: afu_dma_pin_pages
[ 77.664030] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 40: afu_dma_adjust_locked_vm
[ 77.664032] intel-fpga-port intel-fpga-port.0: [3153] RLIMIT_MEMLOCK +2097152 4194304/65536
[ 77.665575] intel-fpga-port intel-fpga-port.0: 512 pages pinned
[ 77.665578] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 133: afu_dma_check_continuous_pages
[ 77.665580] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1887: fpga_pdata_to_pcidev
[ 77.665581] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1880: fpga_feature_dev_to_pcidev
[ 77.665583] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 160: afu_dma_region_add
[ 77.665584] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 77.665585] intel-fpga-port intel-fpga-port.0: add region (iova = ac800000)
[ 77.665587] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 148: dma_region_check_iova
[ 77.665589] intel-fpga-port intel-fpga-port.0: dma map: ua=7f1de9200000, len=200000, iova=ac800000
[ 77.666170] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 408: afu_id_show
[ 77.666171] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 77.666173] LOG: readq: guidl = readq(&afu_hdr->guid.b[0]);
[ 77.794849] LOG: readq: guidh = readq(&afu_hdr->guid.b[8]);
[ 77.935223] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 962: afu_open
[ 77.935225] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1855: fpga_inode_to_feature_dev
[ 77.935227] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1648: feature_dev_use_begin
[ 77.935901] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1171: afu_ioctl
[ 77.935906] intel-fpga-port intel-fpga-port.0: afu_ioctl cmd 0xb540
[ 77.935907] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 379: port_hdr_ioctl
[ 77.935909] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1842: fpga_port_reset
[ 77.935910] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1829: __fpga_port_reset
[ 77.935912] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 282: __fpga_port_disable
[ 77.935913] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 77.981107] LOG: readq: control.csr(0x0000000000000014) = readq(&port_hdr->control(0x0000000040000038));
[ 78.032662] LOG: writeq: writeq(control.csr(0x0000000000000015), &port_hdr->control(0x0000000040000038));
[ 78.032666] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 255: __fpga_port_enable
[ 78.032669] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 78.032670] LOG: readq: control.csr = readq(&port_hdr->control);
[ 78.078533] LOG: writeq: writeq(control.csr, &port_hdr->control);
[ 79.635870] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1171: afu_ioctl
[ 79.635876] intel-fpga-port intel-fpga-port.0: afu_ioctl cmd 0xb544
[ 79.635881] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1154: afu_ioctl_dma_unmap
[ 79.635970] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 362: afu_dma_unmap_region
[ 79.635972] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 281: afu_dma_region_find_iova
[ 79.635973] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 248: afu_dma_region_find
[ 79.635974] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 79.635975] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 148: dma_region_check_iova
[ 79.635976] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 148: dma_region_check_iova
[ 79.635978] intel-fpga-port intel-fpga-port.0: find region (iova = ac800000)
[ 79.635980] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 197: afu_dma_region_remove
[ 79.635981] intel-fpga-port intel-fpga-port.0: del region (iova = ac800000)
[ 79.635982] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 79.635984] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1887: fpga_pdata_to_pcidev
[ 79.635985] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1880: fpga_feature_dev_to_pcidev
[ 79.635986] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 120: afu_dma_unpin_pages
[ 79.635987] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 22: put_all_pages
[ 79.635996] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 40: afu_dma_adjust_locked_vm
[ 79.635999] intel-fpga-port intel-fpga-port.0: [3153] RLIMIT_MEMLOCK -2097152 2097152/65536
[ 79.636000] intel-fpga-port intel-fpga-port.0: 512 pages unpinned
[ 79.636032] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1171: afu_ioctl
[ 79.636034] intel-fpga-port intel-fpga-port.0: afu_ioctl cmd 0xb544
[ 79.636035] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1154: afu_ioctl_dma_unmap
[ 79.636037] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 362: afu_dma_unmap_region
[ 79.636038] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 281: afu_dma_region_find_iova
[ 79.636039] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 248: afu_dma_region_find
[ 79.636040] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 79.636041] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 148: dma_region_check_iova
[ 79.636042] intel-fpga-port intel-fpga-port.0: find region (iova = aca00000)
[ 79.636043] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 197: afu_dma_region_remove
[ 79.636045] intel-fpga-port intel-fpga-port.0: del region (iova = aca00000)
[ 79.636046] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1696: fpga_pdata_get_private
[ 79.636047] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1887: fpga_pdata_to_pcidev
[ 79.636048] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1880: fpga_feature_dev_to_pcidev
[ 79.636049] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 120: afu_dma_unpin_pages
[ 79.636050] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 22: put_all_pages
[ 79.636059] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 40: afu_dma_adjust_locked_vm
[ 79.636061] intel-fpga-port intel-fpga-port.0: [3153] RLIMIT_MEMLOCK -2097152 0/65536
[ 79.636063] intel-fpga-port intel-fpga-port.0: 512 pages unpinned
[ 79.636113] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 1011: afu_release
[ 79.636115] intel-fpga-port intel-fpga-port.0: Device File Release
[ 79.636116] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1662: __feature_dev_use_end
[ 79.636119] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 375: fpga_msix_set_block
[ 79.636120] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 375: fpga_msix_set_block
[ 79.636121] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/afu.c: 711: afu_port_umsg_halt
[ 79.636122] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1873: is_feature_present
[ 79.636123] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 79.636124] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1829: __fpga_port_reset
[ 79.636125] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 282: __fpga_port_disable
[ 79.636126] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 79.682063] LOG: readq: control.csr(0x0000000000000014) = readq(&port_hdr->control(0x0000000040000038));
[ 79.738238] LOG: writeq: writeq(control.csr(0x0000000000000015), &port_hdr->control(0x0000000040000038));
[ 79.738242] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/feature-dev.c: 255: __fpga_port_enable
[ 79.738245] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/include/feature-dev.h: 1865: get_feature_ioaddr_by_index
[ 79.738245] LOG: readq: control.csr = readq(&port_hdr->control);
[ 79.777187] LOG: writeq: writeq(control.csr, &port_hdr->control);
[ 79.826086] LOG: call_stack: /home/user/opae-intel-fpga-driver-1.3.0-2/drivers/fpga/intel/dma-region.c: 210: afu_dma_region_destroy