Generating SQLite file gpu.sqlite from gpu.nsys-rep
Processing [gpu.sqlite] with [/home/dl/.local/sg/nvhpc/Linux_x86_64/26.1/profilers/13.1/Nsight_Systems/host-linux-x64/reports/cuda_api_sum.py]... 

 ** CUDA API Summary (cuda_api_sum):

 Time (%)  Total Time (ms)  Num Calls  Avg (ms)  Med (ms)  Min (ms)  Max (ms)  StdDev (ms)               Name             
 --------  ---------------  ---------  --------  --------  --------  --------  -----------  ------------------------------
     28.5        9753.0704     358406    0.0272    0.0026    0.0011    4.0828       0.2016  cudaStreamSynchronize_ptsz    
     25.8        8831.8305     407600    0.0217    0.0154    0.0003   32.5566       0.1003  cudaEventCreate               
     18.0        6139.4087     348169    0.0176    0.0099    0.0020    3.0621       0.0922  cudaMemcpyAsync_ptsz          
     10.0        3418.6456     407600    0.0084    0.0012    0.0003   15.6495       0.0344  cudaEventDestroy              
      6.8        2309.3625     304712    0.0076    0.0057    0.0024    2.5254       0.0093  cudaLaunchKernel_ptsz         
      3.1        1051.5983     498465    0.0021    0.0020    0.0004    6.0424       0.0087  cudaEventQuery                
      2.8         952.2548     186416    0.0051    0.0035    0.0013    1.2243       0.0081  cudaEventRecord               
      2.8         947.6507     221184    0.0043    0.0033    0.0014   32.2636       0.0777  cudaEventRecord_ptsz          
      1.3         440.7286      58492    0.0075    0.0056    0.0017    1.0336       0.0086  cudaMemsetAsync_ptsz          
      0.7         239.3791      24585    0.0097    0.0066    0.0026    0.7704       0.0104  cuLaunchKernel                
      0.1          46.1804        114    0.4051    0.3407    0.1609    1.3086       0.1881  cuModuleLoadData              
      0.0          13.6582         15    0.9105    0.2057    0.0064    4.9173       1.5792  cudaMalloc                    
      0.0          13.5287         15    0.9019    0.1383    0.0153    4.3246       1.5905  cudaFree                      
      0.0           7.1012          9    0.7890    0.9490    0.0133    2.4316       0.7746  cudaMemcpyAsync               
      0.0           5.4563         26    0.2099    0.0001    0.0001    5.3679       1.0522  cuMemFree_v2                  
      0.0           5.3196        114    0.0467    0.0292    0.0157    0.5876       0.0895  cuModuleUnload                
      0.0           3.1478          6    0.5246    0.3666    0.0729    1.2035       0.4870  cudaMalloc3DArray             
      0.0           3.0667        116    0.0264    0.0093    0.0036    0.9160       0.0984  cuMemcpyHtoD_v2               
      0.0           2.4105          2    1.2053    1.2053    1.2051    1.2054       0.0002  cudaGetDeviceProperties_v12000
      0.0           2.2676          6    0.3779    0.2222    0.1194    0.7817       0.3057  cudaMemcpy3D_ptds             
      0.0           1.0890         54    0.0202    0.0200    0.0067    0.0605       0.0098  cuMemGetInfo_v2               
      0.0           0.7607          6    0.1268    0.1200    0.0645    0.1976       0.0667  cudaFreeArray                 
      0.0           0.4020         19    0.0212    0.0190    0.0141    0.0413       0.0067  cudaMemGetInfo                
      0.0           0.2540          2    0.1270    0.1270    0.1159    0.1381       0.0157  cuMemAlloc_v2                 
      0.0           0.1926        136    0.0014    0.0013    0.0010    0.0036       0.0004  cudaEventSynchronize          
      0.0           0.1169          9    0.0130    0.0052    0.0042    0.0318       0.0122  cudaMemset_ptds               
      0.0           0.0909          9    0.0101    0.0046    0.0028    0.0235       0.0090  cudaMemsetAsync               
      0.0           0.0829         12    0.0069    0.0048    0.0040    0.0155       0.0039  cudaStreamDestroy             
      0.0           0.0756         12    0.0063    0.0046    0.0030    0.0139       0.0039  cudaStreamCreate              
      0.0           0.0664          6    0.0111    0.0105    0.0078    0.0152       0.0033  cudaDeviceSynchronize         
      0.0           0.0633          6    0.0106    0.0093    0.0027    0.0196       0.0085  cudaCreateTextureObject       
      0.0           0.0379          6    0.0063    0.0059    0.0011    0.0115       0.0051  cudaDestroyTextureObject      
      0.0           0.0147         54    0.0003    0.0003    0.0001    0.0007       0.0002  cuCtxSetCurrent               
      0.0           0.0071          1    0.0071    0.0071    0.0071    0.0071       0.0000  cuInit                        
      0.0           0.0053          1    0.0053    0.0053    0.0053    0.0053       0.0000  cuModuleGetLoadingMode        

Processing [gpu.sqlite] with [/home/dl/.local/sg/nvhpc/Linux_x86_64/26.1/profilers/13.1/Nsight_Systems/host-linux-x64/reports/cuda_gpu_kern_sum.py]... 

 ** CUDA GPU Kernel Summary (cuda_gpu_kern_sum):

 Time (%)  Total Time (ms)  Instances  Avg (ms)  Med (ms)  Min (ms)  Max (ms)  StdDev (ms)                                                  Name                                                
 --------  ---------------  ---------  --------  --------  --------  --------  -----------  ----------------------------------------------------------------------------------------------------
     41.5        2081.7453       2048    1.0165    1.0142    0.9271    1.1132       0.0237  void cuda_kernel_diff2_CC_coarse<(bool)1, (bool)0, (int)128>(float *, float *, float *, float *, fl…
     14.1         704.9300       6144    0.1147    0.1034    0.0490    0.5864       0.0546  void cuda_kernel_backproject3D<(bool)0, (bool)0>(float *, float *, float *, float *, float *, float…
      9.3         468.3801       6144    0.0762    0.0682    0.0348    0.5004       0.0364  void cuda_kernel_wavg<(bool)1, (bool)1, (bool)0, (int)256>(float *, AccProjectorKernel, unsigned in…
      7.6         379.3248       4096    0.0926    0.0771    0.0739    0.2606       0.0265  void cuda_kernel_diff2_coarse<(bool)1, (bool)0, (int)128, (int)16, (int)4>(float *, float *, float …
      4.1         205.2410      15784    0.0130    0.0125    0.0097    0.0548       0.0027  void cub::CUB_200802_SM_800::DeviceRadixSortOnesweepKernel<cub::CUB_200802_SM_800::detail::radix::p…
      2.6         129.1368       4096    0.0315    0.0285    0.0280    0.1201       0.0078  void cuda_kernel_diff2_coarse<(bool)1, (bool)0, (int)128, (int)1, (int)4>(float *, float *, float *…
      2.2         110.6958       4096    0.0270    0.0270    0.0148    0.3867       0.0161  void cuda_kernel_diff2_fine<(bool)1, (bool)0, (int)256, (int)7>(float *, float *, float *, float *,…
      1.2          62.5249       4246    0.0147    0.0144    0.0140    0.0296       0.0013  void cub::CUB_200802_SM_800::DeviceRadixSortSingleTileKernel<cub::CUB_200802_SM_800::detail::radix:…
      1.2          61.1712      12288    0.0050    0.0049    0.0043    0.0221       0.0005  void regular_fft<(unsigned int)120, EPT<(unsigned int)10, (unsigned int)12>, (unsigned int)16, (uns…
      1.0          49.0385      12288    0.0040    0.0038    0.0032    0.0172       0.0007  void regular_fft_r2c<(unsigned int)120, EPT<(unsigned int)10, (unsigned int)12>, (unsigned int)8, (…
      0.8          41.1507      18432    0.0022    0.0020    0.0012    0.0229       0.0013  void cuda_kernel_init_value<float>(T1 *, T1, unsigned long, int)                                    
      0.7          37.4995      16384    0.0023    0.0022    0.0017    0.0121       0.0004  void CudaKernels::cuda_kernel_multi<float>(T1 *, T1, int)                                           
      0.7          36.9143      12288    0.0030    0.0027    0.0021    0.0166       0.0009  cuda_kernel_initOrientations(double *, float *, bool *, unsigned long)                              
      0.7          35.8430       6144    0.0058    0.0047    0.0040    0.0204       0.0028  void cuda_kernel_make_eulers_3D<(bool)1, (bool)0, (bool)1>(float *, float *, float *, float *, unsi…
      0.6          31.7665      12288    0.0026    0.0025    0.0020    0.0170       0.0005  void cuda_kernel_window_fourier_transform<(bool)0>(float2 *, float2 *, unsigned long, unsigned long…
      0.6          31.3647       8192    0.0038    0.0039    0.0023    0.0206       0.0012  void cub::CUB_200802_SM_800::DeviceScanKernel<cub::CUB_200802_SM_800::detail::scan::policy_hub<floa…
      0.6          29.3828      12288    0.0024    0.0023    0.0019    0.0214       0.0004  void cuda_kernel_centerFFT_2D<float>(T1 *, int, int, int, int, int)                                 
      0.6          27.6770      12288    0.0023    0.0020    0.0016    0.0113       0.0007  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.5          26.3873       2048    0.0129    0.0125    0.0116    0.0409       0.0016  void cuda_kernel_diff2_CC_fine<(bool)1, (bool)0, (int)256, (int)7>(float *, float *, float *, float…
      0.5          25.0895       6144    0.0041    0.0027    0.0025    0.0193       0.0028  cuda_kernel_allweights_to_mweights(unsigned long *, float *, float *, unsigned long, unsigned long,…
      0.5          24.1841       3946    0.0061    0.0055    0.0047    0.0878       0.0027  void cub::CUB_200802_SM_800::DeviceRadixSortHistogramKernel<cub::CUB_200802_SM_800::detail::radix::…
      0.5          23.4135       4096    0.0057    0.0054    0.0040    0.0289       0.0012  void cub::CUB_200802_SM_800::DeviceSelectSweepKernel<cub::CUB_200802_SM_800::detail::select::policy…
      0.5          23.2619       6211    0.0037    0.0029    0.0022    0.0179       0.0022  void cub::CUB_200802_SM_800::DeviceReduceKernel<cub::CUB_200802_SM_800::detail::reduce::policy_hub<…
      0.4          22.1240       4096    0.0054    0.0052    0.0040    0.0438       0.0010  void cuda_kernel_weights_exponent_coarse<float>(T1 *, bool *, T1 *, bool *, T1 *, T1, int, int, int)
      0.4          22.0748       6144    0.0036    0.0034    0.0028    0.0217       0.0011  cuda_kernel_softMaskBackgroundValue(float *, long, long, long, long, long, long, long, float, float…
      0.4          21.6117       6144    0.0035    0.0031    0.0025    0.0173       0.0013  void cuda_kernel_collect2jobs<(bool)0>(float *, float *, float *, float *, float *, float, float, i…
      0.4          21.5889      12288    0.0018    0.0018    0.0012    0.0062       0.0004  void cuda_kernel_init_complex_value<float2>(T1 *, float, unsigned long, int)                        
      0.4          20.8343       6144    0.0034    0.0031    0.0028    0.0180       0.0010  void cuda_kernel_powerClass<(bool)0>(float2 *, float *, int, int, int, int, int, int, float *)      
      0.4          19.5363       8192    0.0024    0.0024    0.0014    0.0176       0.0008  void cuda_kernel_find_threshold_idx_in_cumulative<float>(T1 *, T1, unsigned long, unsigned long *, …
      0.4          19.1413       8192    0.0023    0.0025    0.0013    0.0419       0.0008  void cuda_kernel_exponentiate<float>(T1 *, T1, unsigned long)                                       
      0.4          18.1979       6144    0.0030    0.0029    0.0025    0.0088       0.0004  cuda_kernel_cosineFilter(float *, long, long, long, long, long, long, long, bool, float *, float, f…
      0.4          17.8306       4096    0.0044    0.0042    0.0036    0.0148       0.0006  cuda_kernel_exponentiate_weights_fine(float *, bool *, float *, bool *, float *, float, int, int, u…
      0.3          15.8851       6144    0.0026    0.0023    0.0019    0.0140       0.0007  void CudaKernels::cuda_kernel_translate2D<float>(T1 *, T1 *, int, int, int, int, int)               
      0.3          14.9167       6211    0.0024    0.0021    0.0017    0.0127       0.0008  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.3          14.0640       6077    0.0023    0.0021    0.0016    0.0147       0.0007  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.3          13.8012       5986    0.0023    0.0021    0.0017    0.0123       0.0007  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.3          13.3699       4163    0.0032    0.0031    0.0023    0.0187       0.0007  void cub::CUB_200802_SM_800::DeviceReduceKernel<cub::CUB_200802_SM_800::detail::reduce::policy_hub<…
      0.3          13.2994       8192    0.0016    0.0014    0.0012    0.0052       0.0005  void cub::CUB_200802_SM_800::DeviceScanInitKernel<cub::CUB_200802_SM_800::ScanTileState<float, (boo…
      0.3          12.9847       4254    0.0031    0.0028    0.0022    0.0218       0.0007  void cub::CUB_200802_SM_800::DeviceReduceKernel<cub::CUB_200802_SM_800::detail::reduce::policy_hub<…
      0.2          12.4826       4096    0.0030    0.0026    0.0022    0.0160       0.0009  void CudaKernels::cuda_kernel_add<float>(T1 *, T1, int)                                             
      0.2          10.5191       4096    0.0026    0.0024    0.0021    0.0237       0.0007  void cuda_kernel_array_over_threshold<float>(T1 *, bool *, T1, unsigned long, int)                  
      0.2           9.9042       3946    0.0025    0.0024    0.0018    0.0064       0.0005  void cub::CUB_200802_SM_800::DeviceRadixSortExclusiveSumKernel<cub::CUB_200802_SM_800::detail::radi…
      0.2           9.8569       4254    0.0023    0.0021    0.0017    0.0100       0.0006  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.2           9.7131       4029    0.0024    0.0023    0.0017    0.0071       0.0006  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.2           9.6346       4163    0.0023    0.0021    0.0017    0.0063       0.0006  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.1           6.7524       4096    0.0016    0.0014    0.0012    0.0054       0.0005  void cub::CUB_200802_SM_800::DeviceCompactInitKernel<cub::CUB_200802_SM_800::ScanTileState<int, (bo…
      0.1           6.0823       2048    0.0030    0.0028    0.0026    0.0137       0.0009  void cub::CUB_200802_SM_800::DeviceReduceKernel<cub::CUB_200802_SM_800::detail::reduce::policy_hub<…
      0.1           4.5308       2048    0.0022    0.0021    0.0017    0.0100       0.0006  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.1           4.4356       2048    0.0022    0.0020    0.0017    0.0118       0.0006  void cub::CUB_200802_SM_800::DeviceReduceSingleTileKernel<cub::CUB_200802_SM_800::detail::reduce::p…
      0.0           0.8858          6    0.1476    0.1472    0.1425    0.1554       0.0054  void regular_fft<(unsigned int)240, EPT<(unsigned int)5, (unsigned int)6, (unsigned int)8>, (unsign…
      0.0           0.7646          3    0.2549    0.2548    0.2548    0.2550       0.0001  void regular_fft_r2c<(unsigned int)240, EPT<(unsigned int)5, (unsigned int)6, (unsigned int)8>, (un…
      0.0           0.5731          3    0.1910    0.1460    0.0743    0.3527       0.1446  void cuda_kernel_calcPowerSpectrum<double2>(T1 *, int, T1 *, int, double *, double *, int, int, dou…
      0.0           0.4766          3    0.1589    0.1619    0.1525    0.1622       0.0055  void cuda_kernel_centerFFTbySign<double2>(T1 *, int, int, int)                                      
      0.0           0.3942          3    0.1314    0.1324    0.1278    0.1340       0.0032  void CudaKernels::cuda_kernel_multi<double>(T1 *, T1, int)                                          
      0.0           0.2566          3    0.0855    0.0860    0.0845    0.0860       0.0009  void cuda_kernel_window_transform<double>(T1 *, T1 *, int, int, int, int, int, int, int, int, int)  
      0.0           0.1007          3    0.0336    0.0357    0.0291    0.0359       0.0039  cuda_kernel_griddingCorrect(double *, int, double, double, unsigned long, unsigned long, unsigned l…
      0.0           0.0069          3    0.0023    0.0024    0.0021    0.0024       0.0002  cuda_kernel_updatePowerSpectrum(double *, double *, int)                                            

Processing [gpu.sqlite] with [/home/dl/.local/sg/nvhpc/Linux_x86_64/26.1/profilers/13.1/Nsight_Systems/host-linux-x64/reports/cuda_gpu_mem_time_sum.py]... 

 ** CUDA GPU MemOps Summary (by Time) (cuda_gpu_mem_time_sum):

 Time (%)  Total Time (ms)  Count   Avg (ms)  Med (ms)  Min (ms)  Max (ms)  StdDev (ms)            Operation           
 --------  ---------------  ------  --------  --------  --------  --------  -----------  ------------------------------
     46.6         435.2617  200823    0.0022    0.0017    0.0010    1.0685       0.0051  [CUDA memcpy Host-to-Device]  
     39.4         367.9327  135183    0.0027    0.0016    0.0010    1.9410       0.0111  [CUDA memcpy Device-to-Host]  
     11.0         102.9436   58510    0.0018    0.0017    0.0010    0.0223       0.0006  [CUDA memset]                 
      2.8          26.1537   12288    0.0021    0.0020    0.0016    0.0329       0.0005  [CUDA memcpy Device-to-Device]
      0.2           1.5193       6    0.2532    0.0991    0.0452    0.6218       0.2811  [CUDA memcpy Host-to-Array]   

