Technology

63096 readers

3900 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each other!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed
Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago

MODERATORS

New downloads of DeepSeek suspended in South Korea, data protection agency says (www.channelnewsasia.com)

submitted 5 days ago by fne8w2ah to c/technology

10 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] UndulyUnruly 4 points 5 days ago (1 children)

ensure i get an abliterated version

Could you expand on this re how, please and thank you.

[–] [email protected] 16 points 5 days ago* (last edited 5 days ago) (2 children)

Sure. Here you go.

[–] hummingbird 2 points 5 days ago (1 children)

Learned something new. Thank you!

[–] [email protected] 3 points 5 days ago* (last edited 5 days ago) (1 children)

You can also run your own fancy front-end and host your own GPT website (locally).

[–] [email protected] 1 points 5 days ago

I'm doing that with docker compose in my homelab, it's pretty neat!

services:
  ollama:
    volumes:
      - /etc/ollama-docker/ollama:/root/.ollama
    container_name: ollama
    pull_policy: always
    tty: true
    restart: unless-stopped
    image: ollama/ollama
    ports:
      - 11434:11434
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              device_ids: ['0']
              capabilities:
                - gpu

  open-webui:
    build:
      context: .
      args:
        OLLAMA_BASE_URL: '/ollama'
      dockerfile: Dockerfile
    image: ghcr.io/open-webui/open-webui:main
    container_name: open-webui
    volumes:
      - /etc/ollama-docker/open-webui:/app/backend/data
    depends_on:
      - ollama
    ports:
      - 3000:8080
    environment:
      - 'OLLAMA_BASE_URL=http://ollama:11434/'
      - 'WEBUI_SECRET_KEY='
    extra_hosts:
      - host.docker.internal:host-gateway
    restart: unless-stopped

volumes:
  ollama: {}
  open-webui: {}

[–] UndulyUnruly 2 points 5 days ago

Much obliged!