Ultimate AI Connector for WebLLM
Ultimate AI Connector for WebLLM coj AI inference uas khiav ncaj qha hauv browser los rau koj WordPress multisite network. Nws khiav cov qauv lus loj tag nrho hauv browser siv WebLLM thiab MLC engine — tsis tas muaj API keys, tsis muaj kev hu mus sab nraud, thiab tsis muaj ntaub ntawv tawm ntawm tus neeg siv lub cuab yeej.
Cov Nta Tseem Ceeb
- Inference sab browser: LLM khiav hauv zos hauv tus qhua lub browser dhau WebLLM/MLC — tsis tas yuav muaj server GPU
- Chat widget ntab: Cov neeg siv uas login lawm tuaj yeem sau prompt rau LLM sab browser ncaj qha ntawm front end
- Admin-bar status indicator: Pom status tiag-sijhawm ntawm WebLLM engine hauv WordPress admin bar
- SharedWorker runtime: Ntau browser tabs siv ib GPU session ua ke es tsis txhob sib tw siv GPU resources
- apiFetch middleware: WordPress REST requests uas phim AI Client SDK pattern raug xa ncaj qha mus rau local WebLLM broker yam pob tshab — tsis muaj loopback HTTP round-trip
- Widget settings UI: Connector panel settings los qhib/kaw chat widget thiab teeb tsa auto-prompt behaviour
- IndexedDB cache: Model weight downloads tseem nyob txawm CDN redirects ua rau default Cache API path tawg
- wpai filter integration: Hook rau hauv
wpai_preferred_text_modelsfilter kom AI Experiments feature xa mus rau browser engine thaum teeb tsa lawm
Yam Yuav Tsum Muaj
- WordPress 5.3 lossis siab dua
- PHP 7.4 lossis siab dua
- Ultimate Multisite plugin (qhib)
- Browser uas muaj WebGPU support (Chrome 113+, Edge 113+, lossis Firefox Nightly uas qhib WebGPU lawm)
Kev Txhim Kho
- Upload cov addon files mus rau koj
/wp-content/plugins/directory - Qhib plugin dhau ntawm 'Plugins' menu hauv WordPress
- Mus rau Ultimate Multisite → AI Connector los teeb tsa addon
Chat Widget Ntab
Chat widget ntab tso cai rau txhua tus neeg siv uas login lawm los sib tham nrog LLM sab browser ncaj qha ntawm koj front end, yam tsis tas tawm ntawm nplooj ntawv uas lawv tab tom nyob.
Nws Ua Dab Tsi
Thaum qhib lawm, ib lub chat icon yuav tshwm nyob rau kaum ntawm txhua front-end page rau cov neeg siv uas login lawm. Nias lub icon yuav qhib ib lub chat panel uas tus neeg siv tuaj yeem ntaus prompts thiab tau txais cov lus teb los ntawm WebLLM model uas khiav hauv zos. Vim model khiav tag nrho hauv browser, cov lus teb yog ntiag tug thiab tsis muaj kev ua haujlwm sab server.
Admin-Bar Status Indicator
WordPress admin bar muaj ib lub status indicator uas qhia lub xeev tam sim no ntawm WebLLM engine:
| Status | Lub ntsiab lus |
|---|---|
| Loading | MLC engine tab tom initialising lossis downloading model weights |
| Ready | Model tau loaded lawm thiab muaj rau inference |
| Idle | Engine tau loaded lawm tab sis SharedWorker tab tsis active |
| Error | Engine initialise tsis tiav — xyuas browser console rau cov ntsiab lus |
Lub indicator hloov tshiab tiag-sijhawm yam tsis tas reload nplooj ntawv.
Yuav Qhib lossis Kaw Widget Li Cas
- Mus rau Ultimate Multisite → AI Connector hauv network admin
- Nrhiav Connector panel
- Toggle Enable floating chat widget qhib lossis kaw
- Save settings
Widget kuj qhib lossis kaw tau per-site los ntawm site tus kheej admin yog network administrator tau tso cai ntawd lawm.
Widget Settings
Connector panel hauv Ultimate Multisite → AI Connector muaj cov settings hauv qab no rau chat widget ntab:
Enable Floating Chat Widget
Toggle chat widget qhib lossis kaw rau tag nrho network. Thaum kaw lawm, widget yuav tsis tshwm rau ib nplooj front-end page twg, txawm tus neeg siv muaj role dab tsi los xij.
Default: Kaw
Auto-Prompt Behaviour
Tswj seb chat widget puas xa prompt cia li thaum tus neeg siv qhib nws.
| Option | Behaviour |
|---|---|
| Disabled | Widget qhib rau ib qho chat khoob — tus neeg siv ntaus lawv tus kheej prompt |
| Page context | Widget qhib nrog ib prompt uas twb pre-filled raws li nplooj ntawv tam sim no lub title thiab content |
| Custom prompt | Widget qhib nrog ib custom prompt uas koj txhais hauv field hauv qab no |
Thaum teeb rau Custom prompt, ib text field ntxiv yuav tshwm uas koj tuaj yeem sau default prompt text. Txhawb basic template variables:
{site_name}— lub npe ntawm site tam sim no{page_title}— lub title ntawm nplooj ntawv tam sim no{user_display_name}— display name ntawm tus neeg siv uas login lawm
Default: Disabled
SharedWorker Runtime
Version 1.1.0 qhia SharedWorker runtime rau MLC engine. Yav dhau los, txhua browser tab uas siv WebLLM load nws tus kheej instance ntawm model, sib tw rau GPU memory thiab ua rau muaj performance issues ntawm cov cuab yeej uas muaj VRAM tsawg.
Nrog SharedWorker runtime, ib tab ua tus engine host. Tag nrho lwm tabs sib txuas lus nrog tib instance ntawd dhau ntawm worker's message channel. Qhov tshwm sim:
- Ib GPU session siv ua ke thoob txhua tabs uas qhib
- Cov lus teb sai dua thaum model loaded lawm (tsis rov initialisation ntau zaug)
- Kev siv memory siab tshaj qis dua ntawm lub cuab yeej
SharedWorker yog pob tshab rau cov neeg siv. Admin-bar status indicator yeej qhia lub xeev ntawm shared engine tas li, tsis yog ib tab xwb.
apiFetch Middleware
Addon txhim kho ib apiFetch middleware uas intercept WordPress REST API requests uas phim AI Client SDK pattern. Es tsis txhob ua loopback HTTP request mus rau server, cov requests no raug xa ncaj qha mus rau local WebLLM broker uas khiav hauv SharedWorker.
Qhov no txhais tias plugins thiab themes uas siv WordPress apiFetch API standard los hu AI endpoints yuav tau txais txiaj ntsig ntawm model sab browser cia li thaum muaj, tsis tas hloov code li.
Hooks thiab Filters
Filters
wpai_preferred_text_models— Sau npe WebLLM browser engine ua ib qho text model uas nyiam siv. Lub addon txuas rau filter no cia li thaum engine raug teeb tsa thiab muaj siv tau.ultimate_webllm_widget_enabled— Hloov override qhov widget enabled state rau ib tug user lossis context tshwj xeeb. Xa rov qabtruelossisfalse.ultimate_webllm_auto_prompt— Kho auto-prompt text ua ntej nws raug xa mus rau widget. Txais prompt string thiabWP_Postobject tam sim no.
Kev daws teeb meem
Lub chat widget tsis tshwm
- Xyuas kom meej tias user tau logged in — widget tsuas qhia rau cov user uas twb authenticate lawm xwb
- Xyuas tias Enable floating chat widget raug toggle on hauv Connector panel
- Tshawb xyuas tias user lub browser txhawb WebGPU (saib Requirements saum toj)
Qhov admin-bar indicator qhia "Yuam kev"
Qhib browser developer console (F12) thiab nrhiav cov yuam kev uas cuam tshuam nrog WebLLM. Cov laj thawj uas nquag muaj:
- Browser tsis txhawb WebGPU
- Model weight download poob — xyuas network connectivity thiab sim clear IndexedDB cache hauv browser developer tools (Application → IndexedDB)
- Ib qho browser extension tab tom thaiv SharedWorker
Model weights download txhua zaus
Lub addon siv IndexedDB ua cache backend kom paub tseeb tias model weights tseem nyob txawm muaj CDN redirects. Yog weights rov download dua txhua zaus mus saib, xyuas tias IndexedDB tsis raug clear los ntawm ib qho browser privacy setting lossis extension.
Changelog
Saib Changelog rau keeb kwm version tag nrho.