frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: Best on device LLM tooling for PDFs?

4•martinald•1y ago
I've got very used to using the "big" LLMs for analysing PDFs

Now llama.cpp has vision support; I tried out PDFs with it locally (via LM Studio) but the results weren't as good as I hoped for. One time it insisted it couldn't do "OCR", but gave me an example of what the data _could_ look like - which was the data.

The other major problem is sometimes PDFs are actually made up of images; and it got super confused on those as well.

Given this is so new I'm struggling to find any tools which make this easier.

Comments

raymond_goo•1y ago
Try something like this

  !pip install pytesseract pdf2image pillow
  !apt install poppler-utils
  #!apt install tesseract-ocr
  from pdf2image import convert_from_path
  import pytesseract

  pages = convert_from_path('k.pdf', dpi=300)

  all_text = ""
  for page_num, img in enumerate(pages, start=1):
      text = pytesseract.image_to_string(img)
      all_text += f"\n--- Page {page_num} ---\n{text}"

  print(all_text)
constantinum•1y ago
give https://pg.llmwhisperer.unstract.com/ a try

Ask HN: What livestream do you keep open in a tab?

37•missmoss•10h ago•14 comments

Ask HN: Which Jabber clients support SCRAM+ and XEP-0474

8•Bender•9h ago•0 comments

Ask HN: HotPin – lossless 120B MoE inference on 24GB RAM (CPU, 50 loc)

5•LozzKappa•8h ago•0 comments

Ask HN: What do you watch during lunch or dinner, if you're by yourself?

4•MinimalAction•4h ago•12 comments

Timed YouTube video transcripts in .txt and .pdf

6•cristyg0101•11h ago•1 comments

Is AI used in school system and how are they implementing it

3•rohankc_01•5h ago•2 comments

What happens behind the scenes when we change effort for same LLM models?

11•tbharath•12h ago•8 comments

Ask HN: What's expected from an engineering manager or director now?

3•agentwrangler•5h ago•4 comments

Who's making money from using/exploiting AI?

9•jonthepirate•12h ago•3 comments

Ask HN: How to get your open-source project gain popularity?

3•Hussain04•9h ago•11 comments

Ask HN: What are some popular AI detection software that you know/have used?

2•dd-sharma•7h ago•1 comments

Ask HN: What happens when we do compress the context in Claude Code?

5•tbharath•11h ago•4 comments

What is the status on continual learning for LLMs?

5•fred123123•8h ago•13 comments

Ask HN: What do you do when your AI agents are working?

4•mavsman•9h ago•1 comments

Ask HN: Is neuromorphic computing going to replace traditional AI?

5•lennart-rth•17h ago•2 comments

Tell HN: A.I Labs are headed by people without world manufacturing experience

3•dzonga•11h ago•1 comments

Tell HN: Namecheap gave my account to an unverified third party

482•Thrashed•2d ago•175 comments

Postgress in Rust

4•poldex•20h ago•1 comments

The Cost of Seamlessness

3•taotuner•11h ago•1 comments

Will it be possible to do LLM Pool Training?

2•slicktux•11h ago•2 comments

Has anyone figured out how to guard LLMs on kernel level?

3•isaacnsisong•16h ago•1 comments

Tell HN: It's a Lot

7•mettamage•17h ago•3 comments

Ask HN: Why are Meta products so bad?

4•asxndu•12h ago•3 comments

Ask HN: How would you harden AI changes to a 1M-line legacy SaaS before review?

4•thegreatkahuna•19h ago•14 comments

Why My Open-Source Project Hasn't Done Better

4•yohji1984•14h ago•1 comments

Companies are optimizing models for specific benchmarks

4•mzubairtahir•21h ago•0 comments

The things that matter take a minute

4•ishener•11h ago•0 comments

Ask HN: Do types make a language more expressive, or less?

3•greenlimetea•16h ago•1 comments

Ask HN: What's Up with Archive.today?

6•nobody9999•1d ago•9 comments

Ask HN: How to use agents via API cheaply?

3•thih9•17h ago•3 comments