#238 I wanted to ask what software is @lucasavila00 using in this image to run mistral and see the layers inside of it ( looks like a gpu profiler)

[xXWarMachineRoXx]

#238 @lucasavila00 , I just found your PR interesting and thought it be great I also could profile my gpu for layers when running llms.
I know its not that difficult of a question but I didn't know where else I could ask that 😅

• So basically, what software did you use to profile your gpu like that?

[EricLBuehler]

@xXWarMachineRoXx , I think he uses Nvidia profiler.

[xXWarMachineRoXx]

thanks for answering!

[lucasavila00]

@xXWarMachineRoXx latest nvidia profiler

[xXWarMachineRoXx]

Thx! Much appreciated!!