{"id":3743,"date":"2012-12-10T09:51:35","date_gmt":"2012-12-10T09:51:35","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/visualstudioalm\/2012\/12\/10\/creating-ngen-pdbs-for-profiling-reports\/"},"modified":"2022-07-21T01:56:04","modified_gmt":"2022-07-21T09:56:04","slug":"creating-ngen-pdbs-for-profiling-reports","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/devops\/creating-ngen-pdbs-for-profiling-reports\/","title":{"rendered":"Creating NGEN PDBs for Profiling Reports"},"content":{"rendered":"

Update: <\/font><\/strong>Visual Studio 2013 will generate PDBs automatically when using the CPU Sampling or the CPU Usage tool<\/a> in the Performance and Diagnostics hub<\/a>. See this post<\/a> for more details!<\/p>\n

When profiling managed applications on Windows 8 any samples in an NGEN\u2019d module will appear in the report as [NI module name] instead of showing the function name, which obviously makes it difficult to understand the report.<\/p>\n

For example in the screenshot below you see [mscorlib.ni.dll], and I can see in the output window that I failed to load symbols (PDB files) for mscorlib.ni.dll even though I enabled Microsoft Symbol Servers in my Visual Studio symbol settings<\/a> (I can tell that the symbol server is working, because immediately below the \u201cfailed to load\u201d for mscorlib.ni.dll I can see that I did load symbols for twinapi.dll)<\/p>\n

\"image\"<\/p>\n

Unfortunately without symbols, you cannot see function names in native modules so all I can tell in the above screenshot is that I\u2019m calling something in mscorlib.ni.dll but I have no idea which function I am calling; where if I\u2019m able to get the symbol file for mscorlib.ni.dll I\u2019ll be able to understand what I\u2019m calling in mscorlib that is expensive. So in this blog post I will show you how to resolve this issue in four steps, but first let\u2019s understand why this is happening.<\/p>\n

Background<\/h2>\n

On Windows 8 the profiler uses a different underlying technology<\/a> than what it does on previous versions of Windows, which is why the behavior is different on Windows 8. With the new technology, the profiler needs the symbol file (PDB) to know what function is currently executing inside NGEN\u2019d images.<\/p>\n

NGEN modules are native modules that are generated on the local machine from the original IL module, so there is no PDB file on the Microsoft symbol servers for framework modules. Furthermore, during NGEN on the local machine there is no PDB file automatically generated for you. Fortunately it\u2019s possible to generate the PDB file yourself and point the profiler to it, so let\u2019s look at the four steps necessary to do that.<\/p>\n

Step 1: Determine where the NI module is on disk<\/h2>\n
    \n
  1. Go to the \u201cModules\u201d view<\/a> in the profiler report.\u00a0\u00a0\u00a0\u00a0\u00a0
    \n\"image\" <\/li>\n
  2. Right click on any column header <\/li>\n
  3. Choose \u201cAdd\/Remove Columns\u2026\u201d from the context menu\u00a0\u00a0\u00a0\u00a0
    \n\"image\" <\/li>\n
  4. In the dialog box that pops up, choose \u201cModule Path\u201d\u00a0\u00a0\u00a0\u00a0
    \n\"image\" <\/li>\n
  5. Click OK <\/li>\n<\/ol>\n

    The module path column now tells you where on disk the module was during collection.<\/p>\n

    Here is a screenshot from my local example:<\/p>\n

    \"image\"<\/p>\n

    Step 2: Create the PDB<\/h2>\n

    To create the PDB, you\u2019re going to use the Native Image Generator (ngen.exe)<\/a> that ships with the .NET framework. Since NGEN\u2019d images are native, it\u2019s important you use the copy of ngen.exe that matches the architecture of the application you are profiling (x86\/x64\/ARM). For example if the application is running 64 bit on Windows 8 RTM then you would need to reference the copy of ngen.exe in \u201cC:WindowsMicrosoft.NETFramework64v4.0.30319\u201d<\/p>\n

      \n
    1. Open a command prompt on the machine where you ran the application during profiling<\/strong> (if you remote profiled a Windows Store App, you have to do this on the machine you were running the app on while you were profiling. It will not work if you do it on the machine you are viewing the report on) <\/li>\n
    2. Decide if you just need to see the names of the functions (use this for .NET libraries*), or if need to be able to get back to the original source file including the ability to see which lines of source code were executing most frequently in the Function Details view<\/a> (only recommended for modules that are part of your project):
      \nIf you don\u2019t need to get back to source<\/strong> then the process is very simple: In a command prompt type \u201c[Microsoft.NET Path][ngen.exe]      12<\/a> createPDB [NI module including the full path from step 1] [directory to store PDB]\u201d, and the PDB for the NGEN\u2019d module will be placed in the directory you specified to store the PDB
      \nThis is an example of generating an NGEN PDB for 32bit mscorlib.ni.dll
      \n\"clip_image012\" <\/li>\n<\/ol>\n
      \n

      **
      \n If you do need to get back to source **then you will need the PDB for the original pre-NGEN\u2019d module. Once you\u2019ve located that type \u201c      ngen.exe<\/a> createPDB [NI module including the full path from step 1] [directory to store PDB] \/lines [directory containing the original PDB]\u201d
      \n NOTE: ngen.exe executes within the security context of the module you are generating the NGEN PDB for. So if you are generating an NGEN PDB for a module that is part of a Windows Store App (this does not mean a framework module such as mscorlib.dll referenced by a Store App), then the output path for the NGEN PDB will need to be in a folder the app has access to (placing it next to the NI module is easiest). Similarly, if you are using the \/lines flag, you will need to ensure that that the original PDB is also in a location accessible to the Windows Store app (again next to the NI is easiest). Once the PDB has been generated, you can move this to any location you like.<\/em><\/p>\n

      Below is an example of generating an NGEN PDB with the \/lines flag for a module in my Windows Store App.
      \n \"clip_image014\"<\/p>\n<\/blockquote>\n

      \n

      \u00a0<\/p>\n

      **PDBs from the Microsoft Symbol Servers do not support the \/lines flag, so will not work for generating line level information for .NET modules*<\/p>\n

      Step 3: Add the PDB to your symbol path<\/h2>\n

      In the Symbols page<\/a>, add the folders containing the NGEN PDBs you created in step 2. This is what that looks like on my machine:<\/p>\n

      \"image\"<\/p>\n

      Step 4: Open the profiler report<\/h2>\n

      Close the report showing the [NI modules], and open it again; assuming you did steps 1-3 correctly you will now see method names instead of [NI module]. For example, using the PDBs I created in Step 2 and modifying my symbol path per Step 3, when I reopen the report that generated my original screen shot I see the following:<\/p>\n

      \"image\"<\/p>\n

      NOTE: The reason the \u201cExclusive Samples %\u201d changed from the first screenshot, is the profiler is now able to distinguish between the individual functions inside mscorlib.ni.dll, where in the first screenshot you only see the total percentage for the entire module<\/em><\/p>\n

      In Closing<\/h2>\n

      Once you\u2019ve created an NGEN PDB for a module, all future reports will reuse the PDBs you have already created. However, if the module is updated or replaced (e.g. it is for your Window Store App and you rebuild it, or there is an update to the .NET framework), then you will need to generate a new NGEN PDB to match the new version of the module.<\/p>\n

      Hope that helps and I’d love to hear any questions\/feedback that you may have so please leave a comment below.<\/p>\n","protected":false},"excerpt":{"rendered":"

      Update: Visual Studio 2013 will generate PDBs automatically when using the CPU Sampling or the CPU Usage tool in the Performance and Diagnostics hub. See this post for more details! When profiling managed applications on Windows 8 any samples in an NGEN\u2019d module will appear in the report as [NI module name] instead of showing […]<\/p>\n","protected":false},"author":68,"featured_media":45953,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1,225],"tags":[],"class_list":["post-3743","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-devops","category-git"],"acf":[],"blog_post_summary":"

      Update: Visual Studio 2013 will generate PDBs automatically when using the CPU Sampling or the CPU Usage tool in the Performance and Diagnostics hub. See this post for more details! When profiling managed applications on Windows 8 any samples in an NGEN\u2019d module will appear in the report as [NI module name] instead of showing […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/3743","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/users\/68"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/comments?post=3743"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/posts\/3743\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media\/45953"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/media?parent=3743"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/categories?post=3743"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/devops\/wp-json\/wp\/v2\/tags?post=3743"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}