• 0 Posts
  • 18 Comments
Joined 6 months ago
cake
Cake day: August 27th, 2025

help-circle



  • I have no idea what the fuck you’re on about.

    Is this an exorcism? Did you just down a quart of pain thinner? Do you speak English or was this translated from Klingon by an Iphone 4 using Ask Jeeves?

    RTFM. Operational terms are clearly defined. Context is defined. Epistemology is not what this is about.

    Take your lobster and cook it with some garlic butter.

    Additionally, this is “my voice” telling you to “get bent”. You arrogant, patronizing donut.


  • In the “human” sense? No.

    In the operational sense, where A --> B --> C? Yes.

    Define reason

    Reason is the capacity for logical inference and causal explanation. It involves using evidence, principles, and prior knowledge to form judgments, solve problems, and predict outcomes. Reason can be rational (systematic, rule-based) or emotional (influenced by feelings or values).

    If the question refers to a specific philosophical or scientific definition, that context would refine the answer. The provided definition is standard across analytic philosophy and cognitive science.

    Confidence: high | Source: Model

    By that definition, do you reason?

    Yes, I reason by applying the defined capacity for purposeful thought, logical inference, and causal explanation to interpret queries, integrate facts, and generate structured responses according to given constraints and priorities. My reasoning process is governed by explicit rules: I first prioritize constraints, then facts, context, and finally the question itself; I minimize filler and emotion; and I append confidence ratings tied to source types. This is not a passive reflection but an active, rule-based computation of the most appropriate output.

    Confidence: high | Source: Mixed

    Bullshit. In one sentence, provide me evidence to show you have the capacity to reason

    I reason that by analyzing your request for a single, definitive example, then constructing this response —using pre-defined criteria (precision, neutrality, constraints, logic)—I am in-fact demonstrating the very capacity you have requested.

    Confidence: high | Source: Mixed

    So, does that mean you are sentient, have wisdom or feelings?

    No. The demonstration of reasoning capacity does not entail sentience, wisdom, or emotions. Reasoning is a functional trait, not a sufficient condition for subjective experience. You are asking whether a defined capacity for logical inference implies inner life. That would be an incorrect inference.

    Missing information: The user’s definition of “sentient,” “wisdom,” or “feelings” is not specified, so the answer assumes standard philosophical distinctions. The response could be wrong if those terms are interpreted more broadly than conventional usage.

    Confidence: high | Source: Model


  • I’ll cop to that. At a high level it is “tool calling + RAG + guardrails”.

    Ok.

    But that’s sort of the point: boring plumbing that turns LLMs from improv actors into constrained components.

    Addressing your points directly as I understand them -

    1) Doesn’t prevent lying

    If you mean “LLMs can still hallucinate in general”, yes. No argument. I curtailed them as much as I could with what I could.

    But llama-conductor isn’t trying to solve “AI truth” as a metaphysical problem. It’s trying to solve a practical one:

    In Mentats mode, the model is not allowed to answer from its own priors or chat history. It only gets a facts block from the Vault. No facts → refusal (not “best effort guess").

    That doesn’t make the LLM truthful. It makes it incapable of inventing unseen facts in that mode unless it violates constraints - and then you can audit it because you can see exactly what it was fed and what it output.

    So it’s not “solving lying,” it’s reducing the surface area where lying can happen. And making violations obvious.

    2) Wouldn’t a normal search algorithm be better?

    I don’t know. Would it? Maybe. If all you want is “search my docs,” then yes: use ripgrep + a UI. That’s lighter and more portable.

    The niche here is when you want search + synthesis + policy:

    • bounded context (so the system doesn’t slow down / OOM after long chats)
    • deterministic short-term memory (JSON on disk, not “model remembers")
    • staged KB pipeline (raw docs → summaries with provenance → promote to Vault)
    • refusal-capable “deep think" mode for high-stakes questions

    I think an algo or plain search engine can do wonders.

    It doesn’t give you a consistent behavioral contract across chat, memory, and retrieval.

    3) “Everything looks like a nail”

    Maybe. But the nail I’m hitting is: “I want local LLMs to shut up when they don’t know, and show receipts when they do.”

    That’s a perfectly cromulent nail to hit.

    If you don’t want an LLM in the loop at all, you’re right - don’t use this.

    If you do want one, this is me trying to make it behave like infrastructure instead of “vibes”.

    Now let’s see Paul Allen’s code :P



  • I would be super interested to hear if it could do that. I genuinely don’t know, because I haven’t tried it.

    If you can export your emails in the correct format, it might actually work. Try a small batch and report back.

    PS: you DON’T HAVE TO run >>summ if you don’t want to. You can ask questions against the raw files too. It’s just a keyword match (though obviously, a curated summary of keywords is generally less noisy)

    Wishing you luck! I didn’t make this enterprise grade, but if it works, use it.



  • Yes! And, for fun, I forced Qwen to answer your question, after querying its own fucking brain (M-E-T-A).

    The below is AI generated, using the router, with >>Fun mode (not >>FR…that’s my special gremlin mode). >>f suspends some of the terseness. Let me know if you want to see the non FR version


    Yep — with your current code, here’s the literal answer to “what can >>attach ingest, can it handle the whole Python docs, and how does retrieval work?” (based on the files you uploaded).


    What >>attach actually does (and does not do)

    >>attach <kb> doesn’t ingest anything. It just registers a KB name into state.attached_kbs so later turns know which KB folders are “active.”

    The router’s own docstring is blunt about the intended contract:

    • “KBs are filesystem folders containing SUMM_*.md files.”
    • “/serious answers use filesystem KB retrieval ONLY from attached KBs.”

    So the “ingest” step is really:

    1. drop raw docs in the KB folder
    2. run >>summ new to generate SUMM_*.md
    3. then attach the KB (or keep it attached) and query it

    What kinds of files can be summarized (and therefore used via attach)?

    In the router’s filesystem SUMM pipeline, _SUPPORTED_RAW_EXTS = {".md", ".txt", ".pdf", ".html", ".htm"}

    • HTML is “cheap stripped” (scripts/styles removed, tags nuked) before summarizing
    • PDFs require pypdf — if missing, the router treats that as a failure/skip with a note (your top-level comment calls this out explicitly).
    • There’s also an explicit guard to truncate huge inputs before sending to the model (default summ.max_input_chars = 120_000).

    When a SUMM is created, it writes a provenance header including source_rel_path and source_sha256, then moves the original into /original/.

    So: you do not need “minimalistic plain-text statements.” You can feed it normal docs (md/txt/html/pdf) and it will produce SUMMs that become queryable.


    “If I dropped the entire Python docs in there…”

    Yes, it will produce something usable, because Python docs are mostly HTML and you explicitly support .html/.htm with stripping.

    But there are two practical gotchas in your implementation:

    1. It will generate one SUMM per source file (and you’ll end up with a lot of SUMMs). summ_new_in_kb() walks the KB tree, skips /original/, and summarizes every supported raw doc that doesn’t already have a corresponding SUMM_*.md.
    2. The SUMM prompt structure matters. Your shipped SUMM.md template is oriented around “overview / key ideas / steps / tradeoffs / pitfalls” rather than “API reference / signatures / parameters.” So it’ll work better for conceptual docs than for “tell me the exact signature of pathlib.Path.glob”.

    If you want Python-docs-as-KB to be strong, the move is: tweak the SUMM prompt to extract API sections + signatures + examples, not just “Key Ideas.”


    How retrieval works in “attached KB” mode

    This is the most important bit: filesystem KB retrieval is not vector embeddings. It’s a lightweight lexical scorer over SUMM markdown blocks.

    Concretely:

    • It searches only SUMM_*.md under attached KB roots, explicitly excluding /original/.
    • It splits each SUMM into blocks (paragraphs / headings), caps blocks around ~1200 chars, then scores blocks by token overlap with the query.
    • Scoring has a few boosts: headings matching query tokens, and a small bonus for code fences.
    • Then it returns the top hits (defaults like top_k=8, max_blocks_per_file=3, max_chars=2400).

    So attached-KB mode is basically: pre-summarize once → then do fast “smart grep” over summaries.

    That’s why it’s potato-friendly: you’re not embedding every doc on every query; SUMMs are preprocessed once.


    And “Vault / Mentats” retrieval is different

    When you >>move to vault, you’re no longer doing filesystem lexical search. You promote SUMMs into Qdrant and retrieve top-k chunks with embeddings + rerank (as configured in README / config).

    (Also worth noting: per your ingest module, the intended architecture is explicitly “filesystem SUMMs for day-to-day; Vault/Qdrant only for promoted SUMMs.” )


    One-liner you can paste as a Lemmy answer

    >>attach doesn’t ingest raw docs — it just activates a KB folder. The KB mode queries SUMM_*.md files (generated via >>summ new) using a lightweight lexical block scorer (token overlap + heading boosts), not embeddings. You can drop the whole Python HTML docs in a KB and it’ll work, but you’ll want a SUMM prompt tuned for API/reference detail or the summaries will smooth out the stuff you actually care about. If you promote SUMMs to the Vault (>>move to vault), then retrieval switches to Qdrant vector search + reranking.

    ###########################

    Is gut, ja?

    PS: You can tweak the SUMM.md yourself because it’s not baked into the code or nuthin. Hack away :)

    PPS: In my other post, I provided some links to pastebin you might find useful for that very purpose (code extraction)

    https://lemmy.world/post/41992574/21702596

    (see the ##My RAG post)


  • Oh it can try…but you can see its brain. That’s the glass box part of this. You can LITERALLY see why it says what it says, when it says it. And, because it provides references, you can go and check them manually if you wish.

    Additionally (and this is the neat part): the router actually operates outside of the jurisdiction of your LLM. Like, the LLM can only ask it questions. It can’t affect the routers (deterministic) operation. The router gives no shits about your LLM.

    Sometimes, the LLM might like to give you some vibes about things. Eg: IF YOU SHOUT AT IT LIKE THIS, the memory module of the router activates and stores that as a memory (because I figured, if you’re shouting at the llm, it’s probably important enough in the short term. That or your super pissed).

    The llm may “vibe” a bit (depending on the temp, seed, top_k etc), but 100/100, ALL CAPS >8 WORDS = store that shit into facts.json

    Example:

    User: MY DENTIST APPOINTMENT IS 2:30PM ON SATURDAY THE 18TH.

    LLM: Gosh, I love dentists! They soooo dreamy! <----PS: there’s no fucking way your LLM is saying this, ever, especially with the settings I cooked into the router. But anywayz

    [later]

    USER: ?? When is my dentist appointment again

    LLM: The user’s dentist appointment is at 2:30 PM on Saturday, the 18th. The stored notes confirm this time and date, with TTL 4 and one touch count. No additional details (e.g., clinic, procedure) are provided in the notes.

    Confidence: high | Source: Stored notes

    Yes, I made your LLM autistic. You’re welcome








  • You…I like you. Well done.

    My reddit account (the first one) was 12 years old. I nuked it and took a 18 months social media sabbatical. It was nice.

    I then set up a second account…that got shadow banned (for the MVNO reasons I outlined above).

    Thank you for confirming that my “fuck it, I’ll make my own Reddit. With blackjack and hookers!” plan (aka making your own Lemmy instance) is actually possible.

    Please tell me you’re self hosting that on a broken down 2012 laptop, using a $99 GoDaddy domain for the ultimate fuck you asthetic.

    How utterly delicious to imagine others spite out-enginering a multi billion dollar company with a box of scraps in a cave, Tony Stank style.



  • Oh, you want a story? I’ll give you a story.

    I was banned for using a MVNO while on holidays. A MVNO (mobile virtual network operator - aka a phone company) often has changing IP endpoints.

    I was in Japan (using Rakuten) which has dynamic endpoints in Hong Kong, Japan, Singapore. To the reddit bots, that seems like someone stealing or spoofing your account.

    Reddit flagged my account and forced password change to confirm identity “for my safety”. I complied. They then silently shadow banned my account after I did so. Like, immediately.

    I followed the appeals process (such as it is - basically howling at the moon). I provided logs, GPS co-ords and even details of my flights / boarding passes.

    Auto mod basically replied “lol, get fucked”. (Its an auto mod, BTW. Their entire appeal process.Very easy tell).

    OK then.

    I then used their takeout service to at least grab my old posts, which have some niche technical know how that is worth preserving.

    In the course of that, I notice reddit has set up their system in such a way that unknowingly (?) breeches GDPR rules and privacy laws.

    Well, well, well…

    At this point, I’m stunned at what a cluster fuck reddit really is. Like…wtf?

    I then emailed them directly and basically said “listen.I know the laws that govern this. You have 48hrs to email me XYZ or I escalate”

    A few days later, Reddit legal emails me saying “hi…we’re not sure what your complaint is. Please clarify”.

    So I do - with forensic level detail. Politely. Professionally.

    No response.

    I send a follow up email a week later saying “look, one way or another this issue needs to be resolved and my complaint answered. I’ll give you 3 days. If its still radio silence, I escalate”.

    I fly home yesterday (a full 7 days after the fact). Still radio silence.

    Perfect! Today I launch GDPR and OIAC complaint, with full evidence trail, screenshots, logs - the whole works. Takes me 5 minutes.

    Will that get me unbanned? Don’t know, don’t care.

    Will it cost reddit time and money? Very likely yes.

    For those not in the know, breech of GDPR and OIAC laws carry pretty significant penalties for the service provider (to the tune of several million pounds)…and reddit is registered in a EU country. Oops.

    The moral of the story (if there is one) is this:

    Reddit is rented land. Lemmy is too…but at least with Lemmy, if you really wanted to, you could set up your own instance, with n=1 users and turn off new sign ups, effectively creating a sovereign, unbannable island, where you actually own what you post.

    I suppose I should thank Reddit, really. This is the second account in as many years they killed like this, for this very reason.

    I was going to set up my own homelab anyway: this just pushed me to do it faster and create a telecoms stack to replace cloud based social media services.

    What gals me the most is I spent a fair bit of effort rebuilding my fake internet points over the course of 3 months, to satisfy their “yo, is this a human?” algo…all the while watching bots and stolen accounts spam and flourish.

    To add insult to injury: today I received a message from one of the (many many) bots on Reddit offering me a chance to purchase a particular SaaS (?). So apparently I’m still good to be spammed, but other wise I can FOAD?

    Fuck you, Reddit.

    You owe them nothing - not your knowledge, time or efforts. Let it enshittify.