So we have had a problem for a long time so weve decided to back propogate the OS version.<\/p>\n\n\n\n
There is an compatability issue with the latest versions of linux nvida kernel drivers arising from the fact they have been built using different version of the cpp compiler.<\/p>\n\n\n\n
This is causing an ABI mismatch fault. A security requirement needs both Linux kernel and NVidia kernel device drivers to have been built using the same generation of compiler.<\/p>\n\n\n\n
The solution is to recompile everything, both Linux kernel and nvidia device drivers using the same toolchain.<\/p>\n\n\n\n
However weve decided were going to back propagate the ubuntu to os level 18. A crazy decision but the reason is that the nvidia toolsets work fine at that generational fault-line.<\/p>\n\n\n\n
We have about 75% of the available toolsets, but its just some key device drivers at kernel level we need to be truly independent.<\/p>\n\n\n\n
So basically, weve been using ollama, nemtron 3 nano with open UI website front end, but mostly from the command line and the results have been mind blowing, really amazing, cuda works, the nsight toolsets work and we can compile and build cuda its just that we need that few extra capabilities so we can run everything compatibility of toolsets is the issue.<\/p>\n\n\n\n
Bringing everything back a few versions, the ABI ( the application Binary Interface) obviously hasn’t caught up with all the different versions and releases and there is also the secure device driver UEFI\/BIOS thing going on here aswell which is another source of compatibility and security issues.<\/p>\n\n\n\n
SO basically its full rebuild from the ground up using slightly ex gen behind the curve versions.<\/p>\n\n\n\n
SO back to the begining again.<\/p>\n","protected":false},"excerpt":{"rendered":"
So we have had a problem for a long time so weve decided to back propogate the OS version. There is an compatability issue with the latest versions of linux nvida kernel drivers arising from the fact they have been built using different version of the cpp compiler. This is causing an ABI mismatch fault. […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-321","post","type-post","status-publish","format-standard","hentry","category-uncategorisedblogpost"],"_links":{"self":[{"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=\/wp\/v2\/posts\/321","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=321"}],"version-history":[{"count":1,"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=\/wp\/v2\/posts\/321\/revisions"}],"predecessor-version":[{"id":322,"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=\/wp\/v2\/posts\/321\/revisions\/322"}],"wp:attachment":[{"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=321"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=321"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thebasicmaterialsproject.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=321"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}