🏠 HTTP 301 - moved permanently to feddit.org 🏠

  • 2 Posts
  • 49 Comments
Joined 1 year ago
cake
Cake day: June 18th, 2023

help-circle







  • I will try cyberpunk one day if its on sale and my pile of shame has gotten smaller.

    I made the switch to Heroic from Lutris because the integration is just better. I used both for a while, bc the witcher 3 worked better on the legacy version for me, and heroic didn’t let you choose the (legacy or nextgen), while lutris only had the legacy version. But now you can install any version you want on Heroic (looking at you, every other platform with forced updates). Also, while Lutris downloads the offline installers off of GOG, heroic installs it via the GOG galaxy redistributable. This also makes it possible to sync playtime and savegames, although this is experimental right now. As soon as they start implementing achievements (which i think they have planned) its feature complete for me.

    Updates of heroic itself and the games always went fine, although it must be said that the most challenging titles i have on gog right now are witcher 3 and metro exodus.



  • I hope so. I’ve been using Linux for 10 years for everything except gaming. And two years ago i went fulltime with proton and lutris (switched to heroic though).

    And let me tell you, we’re at a point where its multiple times more straight forward to just install something like Fedora KDE, and do almost anything windows can, than trying to deal with whatever the hell microsoft is up to these days.

    The biggest problem still is software discoverability. It is our duty to guide newcomers where they want to go instead of gatekeeping.


  • The choice gesture vs. nav button is usually part of android itself. In my case (pixel with therefor nearly stock android) its in settings -> system -> navigation mode (or something similar since its in german in my case). If you can’t find it, search for “navigation button your phone model”.

    Edit: sorry, i just realized you meant the app drawer, not the overview of currently opened apps. I don’t know the answer to that.

    Edit edit: ok i found something in lawnchairs settings. The last setting is called gestures. If you have navigation buttons enabled instead of nav gestures (see above) you could bind the home button to open the app drawer.







  • passepartout@feddit.detoSelfhosted@lemmy.worldSelf hosted LLM
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    8 months ago

    Yes, since we have similar gpus you could try the following to run it in a docker container on linux, taken from here and slightly modified:

    #!/bin/bash
    
    model=microsoft/phi-2
    # share a volume with the Docker container to avoid downloading weights every run
    volume=<path-to-your-data-directory>/data
    
    docker run -e HSA_OVERRIDE_GFX_VERSION=10.3.0 -e PYTORCH_ROCM_ARCH="gfx1031" --device /dev/kfd --device /dev/dri --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:1.4-rocm --model-id $model
    

    Note how the rocm version has a different tag and that you need to mount your gpu device into the container. The two environment variables are specific to my (any maybe yours also) gpu architecture. It will need a while to download though.


  • Huggingface TGI is just a piece of software handling the models, like gpt4all. Here is a list of models officially supported by TGI, although they state that you can try different ones as well. You follow the link and look for the files section. The size of the model files (safetensors or pickele binaries) gives a good estimate of how much vram you will need. Sadly this is more than most consumer graphics cards have except for santacoder and microsoft phi.