• brucethemoose@lemmy.world
    link
    fedilink
    arrow-up
    5
    arrow-down
    1
    ·
    edit-2
    10 hours ago

    You don’t strictly need a huge GPU. These days, there are a lot of places for free generations (like the AI Horde), and a lot of quantization/optimization that gets things running on small VRAM pools if you know where to look. Renting GPUs on vast.ai is pretty cheap.

    Also, I’d recommend languagetool as a locally runnable (and AI free/CPU only) grammar checker. It’s pretty good!

    As for online services, honestly Gemini Pro via the AI Studio web app is way better and way more generous than ChatGPT, or pretty much anything else. It can ingest an entire story for context, and stay coherent. I don’t like using Google, but if I’m not paying them a dime…

    • nicgentile@lemmy.world
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      10 hours ago

      Well, if I am going to push this into the project I envision, privacy is going to be key, so everything will be done locally. I have privacy concerns about running on someone else’s hardware regardless of the provided guardrails and layers of protection I can provide for myself.

      I used to use Languagetool and Scribens but found my current working model as the best for me at the moment. I will definitely look at options as I move to the next chapter so Languagetool is still an option. Also, I believe they went AI too? At least online?

      • brucethemoose@lemmy.world
        link
        fedilink
        arrow-up
        3
        arrow-down
        1
        ·
        edit-2
        10 hours ago

        Well, if I am going to push this into the project I envision, privacy is going to be key, so everything will be done locally.

        Reasonable! And yes languagetool has some online AI thing, probably a junky wrapper around an LLM API TBH.


        One thing I’d be wary of is… well, showing you’re using AI?

        As a random example, I helped clean up a TV show a long time ago, with mixed results. More recently, I brought the idea of making another attempt to the fandom, and got banned for even considering “AI,” with most of them clearly oblivious to how the original restoration was made… I have a little personal writing project going too, and wouldn’t dare bring it up to the fandom either.

        I don’t know what’s involved in your project, but be aware that you may get some very hostile interaction if it’s apparent you use diffusion models and LLMs as helpers.

        • nicgentile@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          1 hour ago

          I’ve been planning for two years now on how to successfully put this together.

          First thing I realised I would have to learn is tools like Blender, Gimp (which I will likely replace with Krita), etc. cause regardless of how well AI produces, you need to tidy things up.

          Then there is story boarding. No amount of AI can replace professionalism. So this is an important skill to have.

          Then there are the layouts. All that. I learnt how to use Scribus for layouts and Inkscape is always handy.

          My main struggle will be maintaining consistency which has improved consistently over the last two years, and I’ve been reading a ton of comics to learn the sort of views and angles they use.

          I can’t allow AI to generate text for me, cause that loses the plot. I might as well just prompt a story up and put it on Amazon and move on. I don’t want to do that. Instead I let it suggest better phrasing, words, basically a better editor.

          I also created my own theme and it, very nicely, points out when I lose the plot. I then ask it to point out where my story sucks and it will also point that out. If I run my text through an AI text detector, I get like 1-2% written by AI which I believe any AI language tool would do. It points out where it detects the AI written text and I work on it and remove the text. GPT has a habit of adding its own text and does not stick to the boundaries set.