![](\"https://zerodha.tech/static/images/github-badge.svg\"){kind=icon}
\n\n[](https://listmonk.app)\n\nlistmonk is a standalone, self-hosted, newsletter and mailing list manager. It is fast, feature-rich, and packed into a single binary. It uses a PostgreSQL database as its data store.\n\n[](https://listmonk.app)\n\nVisit [listmonk.app](https://listmonk.app) for more info. Check out the [**live demo**](https://demo.listmonk.app).\n\n## Installation\n\n### Docker\n\nThe latest image is available on DockerHub at [`listmonk/listmonk:latest`](https://hub.docker.com/r/listmonk/listmonk/tags?page=1&ordering=last_updated&name=latest).\nDownload and use the sample [docker-compose.yml](https://github.com/knadh/listmonk/blob/master/docker-compose.yml).\n\n\n```shell\n# Download the compose file to the current directory.\ncurl -LO https://github.com/knadh/listmonk/raw/master/docker-compose.yml\n\n# Run the services in the background.\ndocker compose up -d\n```\nVisit `http://localhost:9000`\n\nSee [installation docs](https://listmonk.app/docs/installation)\n\n__________________\n\n### Binary\n- Download the [latest release](https://github.com/knadh/listmonk/releases) and extract the listmonk binary.\n- `./listmonk --new-config` to generate config.toml. Edit it.\n- `./listmonk --install` to setup the Postgres DB (or `--upgrade` to upgrade an existing DB. Upgrades are idempotent and running them multiple times have no side effects).\n- Run `./listmonk` and visit `http://localhost:9000`\n\nSee [installation docs](https://listmonk.app/docs/installation)\n__________________\n\n\n## Developers\nlistmonk is free and open source software licensed under AGPLv3. If you are interested in contributing, refer to the [developer setup](https://listmonk.app/docs/developer-setup). The backend is written in Go and the frontend is Vue with Buefy for UI. \n\n\n## License\nlistmonk is licensed under the AGPL v3 license.\n"
},
{
"path": "SECURITY.md",
"content": "# Reporting security issues\n\nPlease refer to https://listmonk.app/docs/security-reports/ first to see the list of non-issues and acceptable-risks before reporting a vulnerability.\n\n"
},
{
"path": "VERSION",
"content": "$Format:%h$\n$Format:%D$\n"
},
{
"path": "cmd/admin.go",
"content": "package main\n\nimport (\n\t\"encoding/json\"\n\t\"fmt\"\n\t\"net/http\"\n\t\"syscall\"\n\t\"time\"\n\n\t\"github.com/knadh/listmonk/internal/captcha\"\n\t\"github.com/labstack/echo/v4\"\n\tnull \"gopkg.in/volatiletech/null.v6\"\n)\n\ntype serverConfig struct {\n\tRootURL string `json:\"root_url\"`\n\tFromEmail string `json:\"from_email\"`\n\tPublicSubscription struct {\n\t\tEnabled bool `json:\"enabled\"`\n\t\tCaptchaEnabled bool `json:\"captcha_enabled\"`\n\t\tCaptchaProvider null.String `json:\"captcha_provider\"`\n\t\tCaptchaKey null.String `json:\"captcha_key\"`\n\t\tAltchaComplexity int `json:\"altcha_complexity\"`\n\t} `json:\"public_subscription\"`\n\tPrivacy struct {\n\t\tDisableTracking bool `json:\"disable_tracking\"`\n\t\tIndividualTracking bool `json:\"individual_tracking\"`\n\t} `json:\"privacy\"`\n\tMediaProvider string `json:\"media_provider\"`\n\tMessengers []string `json:\"messengers\"`\n\tLangs []i18nLang `json:\"langs\"`\n\tLang string `json:\"lang\"`\n\tPermissions json.RawMessage `json:\"permissions\"`\n\tUpdate *AppUpdate `json:\"update\"`\n\tNeedsRestart bool `json:\"needs_restart\"`\n\tHasLegacyUser bool `json:\"has_legacy_user\"`\n\tVersion string `json:\"version\"`\n}\n\n// GetServerConfig returns general server config.\nfunc (a *App) GetServerConfig(c echo.Context) error {\n\tout := serverConfig{\n\t\tRootURL: a.urlCfg.RootURL,\n\t\tFromEmail: a.cfg.FromEmail,\n\t\tLang: a.cfg.Lang,\n\t\tPermissions: a.cfg.PermissionsRaw,\n\t\tHasLegacyUser: a.cfg.HasLegacyUser,\n\t\tPrivacy: struct {\n\t\t\tDisableTracking bool `json:\"disable_tracking\"`\n\t\t\tIndividualTracking bool `json:\"individual_tracking\"`\n\t\t}{\n\t\t\tDisableTracking: a.cfg.Privacy.DisableTracking,\n\t\t\tIndividualTracking: a.cfg.Privacy.IndividualTracking,\n\t\t},\n\t}\n\tout.PublicSubscription.Enabled = a.cfg.EnablePublicSubPage\n\n\t// CAPTCHA.\n\tif a.cfg.Security.Captcha.Altcha.Enabled {\n\t\tout.PublicSubscription.CaptchaEnabled = true\n\t\tout.PublicSubscription.CaptchaProvider = null.StringFrom(captcha.ProviderAltcha)\n\t\tout.PublicSubscription.AltchaComplexity = a.cfg.Security.Captcha.Altcha.Complexity\n\t} else if a.cfg.Security.Captcha.HCaptcha.Enabled {\n\t\tout.PublicSubscription.CaptchaEnabled = true\n\t\tout.PublicSubscription.CaptchaProvider = null.StringFrom(captcha.ProviderHCaptcha)\n\t\tout.PublicSubscription.CaptchaKey = null.StringFrom(a.cfg.Security.Captcha.HCaptcha.Key)\n\t}\n\n\tout.MediaProvider = a.cfg.MediaUpload.Provider\n\n\t// Language list.\n\tlangList, err := getI18nLangList(a.fs)\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\tfmt.Sprintf(\"Error loading language list: %v\", err))\n\t}\n\tout.Langs = langList\n\n\tout.Messengers = make([]string, 0, len(a.messengers))\n\tfor _, m := range a.messengers {\n\t\tout.Messengers = append(out.Messengers, m.Name())\n\t}\n\n\ta.Lock()\n\tout.NeedsRestart = a.needsRestart\n\tout.Update = a.update\n\ta.Unlock()\n\tout.Version = versionString\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetDashboardCharts returns chart data points to render ont he dashboard.\nfunc (a *App) GetDashboardCharts(c echo.Context) error {\n\t// Get the chart data from the DB.\n\tout, err := a.core.GetDashboardCharts()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetDashboardCounts returns stats counts to show on the dashboard.\nfunc (a *App) GetDashboardCounts(c echo.Context) error {\n\t// Get the chart data from the DB.\n\tout, err := a.core.GetDashboardCounts()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// ReloadApp sends a reload signal to the app, causing a full restart.\nfunc (a *App) ReloadApp(c echo.Context) error {\n\tgo func() {\n\t\t<-time.After(time.Millisecond * 500)\n\n\t\t// Send the reload signal to trigger the wait loop in main.\n\t\ta.chReload <- syscall.SIGHUP\n\t}()\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n"
},
{
"path": "cmd/archive.go",
"content": "package main\n\nimport (\n\t\"bytes\"\n\t\"encoding/json\"\n\t\"html/template\"\n\t\"net/http\"\n\t\"net/url\"\n\n\t\"github.com/gorilla/feeds\"\n\t\"github.com/knadh/listmonk/internal/manager\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n\tnull \"gopkg.in/volatiletech/null.v6\"\n)\n\ntype campArchive struct {\n\tUUID string `json:\"uuid\"`\n\tSubject string `json:\"subject\"`\n\tContent string `json:\"content\"`\n\tCreatedAt null.Time `json:\"created_at\"`\n\tSendAt null.Time `json:\"send_at\"`\n\tURL string `json:\"url\"`\n}\n\n// GetCampaignArchives renders the public campaign archives page.\nfunc (a *App) GetCampaignArchives(c echo.Context) error {\n\t// Get archives from the DB.\n\tpg := a.pg.NewFromURL(c.Request().URL.Query())\n\tcamps, total, err := a.getCampaignArchives(pg.Offset, pg.Limit, false)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tif len(camps) == 0 {\n\t\treturn c.JSON(http.StatusOK, okResp{models.PageResults{\n\t\t\tResults: []campArchive{},\n\t\t}})\n\t}\n\n\t// Meta.\n\tout := models.PageResults{\n\t\tResults: camps,\n\t\tTotal: total,\n\t\tPage: pg.Page,\n\t\tPerPage: pg.PerPage,\n\t}\n\n\treturn c.JSON(200, okResp{out})\n}\n\n// GetCampaignArchivesFeed renders the public campaign archives RSS feed.\nfunc (a *App) GetCampaignArchivesFeed(c echo.Context) error {\n\tvar (\n\t\tpg = a.pg.NewFromURL(c.Request().URL.Query())\n\t\tshowFullContent = a.cfg.EnablePublicArchiveRSSContent\n\t)\n\n\t// Get archives from the DB.\n\tcamps, _, err := a.getCampaignArchives(pg.Offset, pg.Limit, showFullContent)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Format output for the feed.\n\tout := make([]*feeds.Item, 0, len(camps))\n\tfor _, c := range camps {\n\t\tpubDate := c.CreatedAt.Time\n\n\t\tif c.SendAt.Valid {\n\t\t\tpubDate = c.SendAt.Time\n\t\t}\n\n\t\tout = append(out, &feeds.Item{\n\t\t\tTitle: c.Subject,\n\t\t\tLink: &feeds.Link{Href: c.URL},\n\t\t\tContent: c.Content,\n\t\t\tCreated: pubDate,\n\t\t})\n\t}\n\n\t// Generate the feed.\n\tfeed := &feeds.Feed{\n\t\tTitle: a.cfg.SiteName,\n\t\tLink: &feeds.Link{Href: a.urlCfg.RootURL},\n\t\tDescription: a.i18n.T(\"public.archiveTitle\"),\n\t\tItems: out,\n\t}\n\n\tif err := feed.WriteRss(c.Response().Writer); err != nil {\n\t\ta.log.Printf(\"error generating archive RSS feed: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"public.errorProcessingRequest\"))\n\t}\n\n\treturn nil\n}\n\n// CampaignArchivesPage renders the public campaign archives page.\nfunc (a *App) CampaignArchivesPage(c echo.Context) error {\n\t// Get archives from the DB.\n\tpg := a.pg.NewFromURL(c.Request().URL.Query())\n\tout, total, err := a.getCampaignArchives(pg.Offset, pg.Limit, false)\n\tif err != nil {\n\t\treturn err\n\t}\n\tpg.SetTotal(total)\n\n\ttitle := a.i18n.T(\"public.archiveTitle\")\n\treturn c.Render(http.StatusOK, \"archive\", struct {\n\t\tTitle string\n\t\tDescription string\n\t\tCampaigns []campArchive\n\t\tTotalPages int\n\t\tPagination template.HTML\n\t}{title, title, out, pg.TotalPages, template.HTML(pg.HTML(\"?page=%d\"))})\n}\n\n// CampaignArchivePage renders the public campaign archives page.\nfunc (a *App) CampaignArchivePage(c echo.Context) error {\n\t// ID can be the UUID or slug.\n\tvar (\n\t\tidStr = c.Param(\"id\")\n\t\tuuid, slug string\n\t)\n\tif reUUID.MatchString(idStr) {\n\t\tuuid = idStr\n\t} else {\n\t\tslug = idStr\n\t}\n\n\t// Get the campaign from the DB.\n\tpubCamp, err := a.core.GetArchivedCampaign(0, uuid, slug)\n\tif err != nil || pubCamp.Type != models.CampaignTypeRegular {\n\t\tnotFound := false\n\n\t\t// Camppaig doesn't exist.\n\t\tif er, ok := err.(*echo.HTTPError); ok {\n\t\t\tif er.Code == http.StatusBadRequest {\n\t\t\t\tnotFound = true\n\t\t\t}\n\t\t} else if pubCamp.Type != models.CampaignTypeRegular {\n\t\t\t// Campaign isn't of regular type.\n\t\t\tnotFound = true\n\t\t}\n\n\t\t// 404.\n\t\tif notFound {\n\t\t\treturn c.Render(http.StatusNotFound, tplMessage,\n\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.notFoundTitle\"), \"\", a.i18n.T(\"public.campaignNotFound\")))\n\t\t}\n\n\t\t// Some other internal error.\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\t// \"Compile\" the campaign template with appropriate data.\n\tout, err := a.compileArchiveCampaigns([]models.Campaign{pubCamp})\n\tif err != nil {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\t// Render the campaign body.\n\tcamp := out[0].Campaign\n\tmsg, err := a.manager.NewCampaignMessage(camp, out[0].Subscriber)\n\tif err != nil {\n\t\ta.log.Printf(\"error rendering campaign: %v\", err)\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\treturn c.HTML(http.StatusOK, string(msg.Body()))\n}\n\n// CampaignArchivePageLatest renders the latest public campaign.\nfunc (a *App) CampaignArchivePageLatest(c echo.Context) error {\n\t// Get the latest campaign from the DB.\n\tcamps, _, err := a.getCampaignArchives(0, 1, true)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tif len(camps) == 0 {\n\t\treturn c.Render(http.StatusNotFound, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.notFoundTitle\"), \"\", a.i18n.T(\"public.campaignNotFound\")))\n\t}\n\tcamp := camps[0]\n\n\treturn c.HTML(http.StatusOK, camp.Content)\n}\n\n// getCampaignArchives fetches the public campaign archives from the DB.\nfunc (a *App) getCampaignArchives(offset, limit int, renderBody bool) ([]campArchive, int, error) {\n\tpubCamps, total, err := a.core.GetArchivedCampaigns(offset, limit)\n\tif err != nil {\n\t\treturn []campArchive{}, total, echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"public.errorFetchingCampaign\"))\n\t}\n\n\tmsgs, err := a.compileArchiveCampaigns(pubCamps)\n\tif err != nil {\n\t\treturn []campArchive{}, total, err\n\t}\n\n\tout := make([]campArchive, 0, len(msgs))\n\tfor _, m := range msgs {\n\t\tcamp := m.Campaign\n\n\t\tarchive := campArchive{\n\t\t\tUUID: camp.UUID,\n\t\t\tSubject: camp.Subject,\n\t\t\tCreatedAt: camp.CreatedAt,\n\t\t\tSendAt: camp.SendAt,\n\t\t}\n\n\t\t// The campaign may have a custom slug.\n\t\tif camp.ArchiveSlug.Valid {\n\t\t\tarchive.URL, _ = url.JoinPath(a.urlCfg.ArchiveURL, camp.ArchiveSlug.String)\n\t\t} else {\n\t\t\tarchive.URL, _ = url.JoinPath(a.urlCfg.ArchiveURL, camp.UUID)\n\t\t}\n\n\t\t// Render the full template body if requested.\n\t\tif renderBody {\n\t\t\tmsg, err := a.manager.NewCampaignMessage(camp, m.Subscriber)\n\t\t\tif err != nil {\n\t\t\t\treturn []campArchive{}, total, err\n\t\t\t}\n\t\t\tarchive.Content = string(msg.Body())\n\t\t}\n\n\t\tout = append(out, archive)\n\t}\n\n\treturn out, total, nil\n}\n\n// compileArchiveCampaigns compiles the campaign template with the subscriber data.\nfunc (a *App) compileArchiveCampaigns(camps []models.Campaign) ([]manager.CampaignMessage, error) {\n\n\tvar (\n\t\tb = bytes.Buffer{}\n\t\tout = make([]manager.CampaignMessage, 0, len(camps))\n\t)\n\tfor _, c := range camps {\n\t\tcamp := c\n\t\tif err := camp.CompileTemplate(a.manager.TemplateFuncs(&camp)); err != nil {\n\t\t\ta.log.Printf(\"error compiling template: %v\", err)\n\t\t\treturn nil, echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"public.errorFetchingCampaign\"))\n\t\t}\n\n\t\t// Load the dummy subscriber meta.\n\t\tvar sub models.Subscriber\n\t\tif err := json.Unmarshal([]byte(camp.ArchiveMeta), &sub); err != nil {\n\t\t\ta.log.Printf(\"error unmarshalling campaign archive meta: %v\", err)\n\t\t\treturn nil, echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"public.errorFetchingCampaign\"))\n\t\t}\n\n\t\tm := manager.CampaignMessage{\n\t\t\tCampaign: &camp,\n\t\t\tSubscriber: sub,\n\t\t}\n\n\t\t// Render the subject if it's a template.\n\t\tif camp.SubjectTpl != nil {\n\t\t\tif err := camp.SubjectTpl.ExecuteTemplate(&b, models.ContentTpl, m); err != nil {\n\t\t\t\treturn nil, err\n\t\t\t}\n\t\t\tcamp.Subject = b.String()\n\t\t\tb.Reset()\n\t\t}\n\n\t\tout = append(out, m)\n\t}\n\n\treturn out, nil\n}\n"
},
{
"path": "cmd/auth.go",
"content": "package main\n\nimport (\n\t\"bytes\"\n\t\"encoding/base64\"\n\t\"encoding/json\"\n\t\"errors\"\n\t\"fmt\"\n\t\"image/png\"\n\t\"net/http\"\n\t\"net/mail\"\n\t\"net/url\"\n\t\"strings\"\n\t\"time\"\n\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/internal/i18n\"\n\t\"github.com/knadh/listmonk/internal/notifs\"\n\t\"github.com/knadh/listmonk/internal/tmptokens\"\n\t\"github.com/knadh/listmonk/internal/utils\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n\t\"github.com/pquerna/otp/totp\"\n\t\"github.com/zerodha/simplesessions/v3\"\n\t\"gopkg.in/volatiletech/null.v6\"\n)\n\nconst (\n\tpasswordResetTTL = 30 * time.Minute\n\ttwofaTokenTTL = 5 * time.Minute\n\n\t// Length of reset and 2FA auth tokens.\n\ttmpAuthTokenLen = 64\n)\n\ntype loginTpl struct {\n\tTitle string\n\tDescription string\n\n\tNextURI string\n\tNonce string\n\tPasswordEnabled bool\n\tOIDCProvider string\n\tOIDCProviderLogo string\n\tError string\n}\n\ntype oidcState struct {\n\tNonce string `json:\"nonce\"`\n\tNext string `json:\"next\"`\n}\n\ntype forgotPasswordTpl struct {\n\tTitle string\n\tDescription string\n\tError string\n}\n\ntype resetPasswordTpl struct {\n\tTitle string\n\tDescription string\n\tToken string\n\tEmail string\n\tError string\n}\n\ntype twofaTpl struct {\n\tTitle string\n\tDescription string\n\tToken string\n\tNextURI string\n\tError string\n}\n\nvar (\n\toidcProviders = map[string]struct{}{\n\t\t\"google.com\": {},\n\t\t\"microsoftonline.com\": {},\n\t\t\"auth0.com\": {},\n\t\t\"github.com\": {},\n\t}\n)\n\n// LoginPage renders the login page and handles the login form.\nfunc (a *App) LoginPage(c echo.Context) error {\n\t// Has the user been setup?\n\ta.Lock()\n\tneedsUserSetup := a.needsUserSetup\n\ta.Unlock()\n\n\tif needsUserSetup {\n\t\treturn a.LoginSetupPage(c)\n\t}\n\n\t// Process POST login request.\n\tvar loginErr error\n\tif c.Request().Method == http.MethodPost {\n\t\tloginErr = a.doLogin(c)\n\t\tif loginErr == nil {\n\t\t\treturn c.Redirect(http.StatusFound, utils.SanitizeURI(c.FormValue(\"next\")))\n\t\t}\n\t}\n\n\t// Render the page, with or without POST.\n\treturn a.renderLoginPage(c, loginErr)\n}\n\n// LoginSetupPage renders the first time user login page and handles the login form.\nfunc (a *App) LoginSetupPage(c echo.Context) error {\n\t// Process POST login request.\n\tvar loginErr error\n\tif c.Request().Method == http.MethodPost {\n\t\tloginErr = a.doFirstTimeSetup(c)\n\t\tif loginErr == nil {\n\t\t\ta.Lock()\n\t\t\ta.needsUserSetup = false\n\t\t\ta.Unlock()\n\t\t\treturn c.Redirect(http.StatusFound, utils.SanitizeURI(c.FormValue(\"next\")))\n\t\t}\n\t}\n\n\t// Render the page, with or without POST.\n\treturn a.renderLoginSetupPage(c, loginErr)\n}\n\n// TwofaPage renders the 2FA verification page and handles the 2FA form submission.\nfunc (a *App) TwofaPage(c echo.Context) error {\n\tvar token, next string\n\n\tif c.Request().Method == http.MethodPost {\n\t\ttoken = strings.TrimSpace(c.FormValue(\"token\"))\n\t\tnext = utils.SanitizeURI(c.FormValue(\"next\"))\n\t} else {\n\t\ttoken = strings.TrimSpace(c.QueryParam(\"token\"))\n\t\tnext = utils.SanitizeURI(c.QueryParam(\"next\"))\n\t}\n\n\t// If there's no token, redirect.\n\tif len(token) < tmpAuthTokenLen {\n\t\treturn c.Redirect(http.StatusFound, uriAdmin)\n\t}\n\n\tif next == \"\" || next == \"/\" {\n\t\tnext = uriAdmin\n\t}\n\n\t// Validate the 2FA temp token.\n\tdata, err := tmptokens.Check(token)\n\tif err != nil {\n\t\treturn c.Redirect(http.StatusFound, uriAdmin)\n\t}\n\n\tuserID, ok := data.(int)\n\tif !ok {\n\t\treturn a.renderTwofaPage(c, token, next, a.i18n.T(\"users.invalidRequest\"))\n\t}\n\n\t// Process the 2FA verification POST request.\n\tif c.Request().Method == http.MethodPost {\n\t\treturn a.doTwofaVerify(c, token, userID, next)\n\t}\n\n\t// Render the 2FA verification page.\n\treturn a.renderTwofaPage(c, token, next, \"\")\n}\n\n// Logout logs a user out.\nfunc (a *App) Logout(c echo.Context) error {\n\t// Delete the session from the DB and cookie.\n\tsess := c.Get(auth.SessionKey).(*simplesessions.Session)\n\t_ = sess.Destroy()\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// OIDCLogin initializes an OIDC request and redirects to the OIDC provider for login.\nfunc (a *App) OIDCLogin(c echo.Context) error {\n\t// Verify that the request came from the login page (CSRF).\n\tnonce, err := c.Cookie(\"nonce\")\n\tif err != nil || nonce.Value == \"\" || nonce.Value != c.FormValue(\"nonce\") {\n\t\treturn echo.NewHTTPError(http.StatusUnauthorized, a.i18n.T(\"users.invalidRequest\"))\n\t}\n\n\t// Sanitize the URL and make it relative.\n\tnext := utils.SanitizeURI(c.FormValue(\"next\"))\n\tif next == \"/\" {\n\t\tnext = uriAdmin\n\t}\n\n\t// Preparethe OIDC payload to send to the provider.\n\tstate := oidcState{Nonce: nonce.Value, Next: next}\n\n\tb, err := json.Marshal(state)\n\tif err != nil {\n\t\ta.log.Printf(\"error marshalling OIDC state: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\n\t// Redirect to the external OIDC provider.\n\treturn c.Redirect(http.StatusFound, a.auth.GetOIDCAuthURL(base64.URLEncoding.EncodeToString(b), nonce.Value))\n}\n\n// OIDCFinish receives the redirect callback from the OIDC provider and completes the handshake.\nfunc (a *App) OIDCFinish(c echo.Context) error {\n\t// Verify that the request actually originated from the login request (which sets the nonce value).\n\tnonce, err := c.Cookie(\"nonce\")\n\tif err != nil || nonce.Value == \"\" {\n\t\treturn a.renderLoginPage(c, echo.NewHTTPError(http.StatusUnauthorized, a.i18n.T(\"users.invalidRequest\")))\n\t}\n\n\t// Validate the OIDC token.\n\toidcToken, claims, err := a.auth.ExchangeOIDCToken(c.Request().URL.Query().Get(\"code\"), nonce.Value)\n\tif err != nil {\n\t\treturn a.renderLoginPage(c, err)\n\t}\n\n\t// Validate the state.\n\tvar state oidcState\n\tstateB, err := base64.URLEncoding.DecodeString(c.QueryParam(\"state\"))\n\tif err != nil {\n\t\ta.log.Printf(\"error decoding OIDC state: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\tif err := json.Unmarshal(stateB, &state); err != nil {\n\t\ta.log.Printf(\"error unmarshalling OIDC state: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\tif state.Nonce != nonce.Value {\n\t\treturn a.renderLoginPage(c, echo.NewHTTPError(http.StatusUnauthorized, a.i18n.T(\"users.invalidRequest\")))\n\t}\n\n\t// Validate e-mail from the claim.\n\temail := strings.TrimSpace(claims.Email)\n\tif email == \"\" {\n\t\treturn a.renderLoginPage(c, errors.New(a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"email\")))\n\t}\n\tem, err := mail.ParseAddress(email)\n\tif err != nil {\n\t\treturn a.renderLoginPage(c, err)\n\t}\n\temail = strings.ToLower(em.Address)\n\tclaims.Email = email\n\n\t// Get the user by e-mail received from OIDC.\n\tuser, userErr := a.core.GetUser(0, \"\", email)\n\tif userErr != nil {\n\t\t// If the user doesn't exist, and auto-creation is enabled, create a new user.\n\t\tif httpErr, ok := userErr.(*echo.HTTPError); ok && httpErr.Code == http.StatusNotFound && a.cfg.Security.OIDC.AutoCreateUsers {\n\t\t\tu, err := a.createOIDCUser(claims, c)\n\t\t\tif err != nil {\n\t\t\t\treturn a.renderLoginPage(c, err)\n\t\t\t}\n\t\t\tuser = u\n\t\t\tuserErr = nil\n\t\t} else {\n\t\t\treturn a.renderLoginPage(c, userErr)\n\t\t}\n\t}\n\n\t// Update the user login state (avatar, logged in date) in the DB.\n\tif err := a.core.UpdateUserLogin(user.ID, claims.Picture); err != nil {\n\t\treturn a.renderLoginPage(c, err)\n\t}\n\n\t// Set the session in the DB and cookie.\n\tif err := a.auth.SaveSession(user, oidcToken, c); err != nil {\n\t\treturn a.renderLoginPage(c, err)\n\t}\n\n\t// Redirect to the next page.\n\treturn c.Redirect(http.StatusFound, utils.SanitizeURI(state.Next))\n}\n\n// ForgotPage renders the forgot password page and handles the forgot password form.\nfunc (a *App) ForgotPage(c echo.Context) error {\n\t// Process the forgot password request.\n\tif c.Request().Method == http.MethodPost {\n\t\treturn a.doForgotPassword(c)\n\t}\n\n\t// Render the forgot page.\n\tout := forgotPasswordTpl{Title: a.i18n.T(\"users.forgotPassword\")}\n\treturn c.Render(http.StatusOK, \"admin-forgot-password\", out)\n}\n\n// ResetPage renders the reset password page and handles the reset password form.\nfunc (a *App) ResetPage(c echo.Context) error {\n\tvar (\n\t\ttoken = strings.TrimSpace(c.QueryParam(\"token\"))\n\t\temail = strings.ToLower(strings.TrimSpace(c.QueryParam(\"email\")))\n\t)\n\n\t// Validate token and email (don't delete it yet, as we may need it for POST).\n\tdata, err := tmptokens.Check(email)\n\tif err != nil {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.invalidResetLink\")))\n\t}\n\n\ttk, ok := data.(string)\n\tif !ok || tk != token {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.invalidResetLink\")))\n\t}\n\n\t// Validate that the user exists.\n\t_, err = a.core.GetUser(0, \"\", email)\n\tif err != nil {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.invalidResetLink\")))\n\t}\n\n\t// Process the reset password request form with the new passwords.\n\tif c.Request().Method == http.MethodPost {\n\t\treturn a.doResetPassword(c, token, email)\n\t}\n\n\t// Render the reset password form for GET request.\n\treturn a.renderResetPasswordPage(c, token, email, \"\")\n}\n\n// renderLoginPage renders the login page and handles the login form.\nfunc (a *App) renderLoginPage(c echo.Context, loginErr error) error {\n\tnext := utils.SanitizeURI(c.FormValue(\"next\"))\n\tif next == \"/\" {\n\t\tnext = uriAdmin\n\t}\n\n\tvar (\n\t\toidcProviderName = \"\"\n\t\toidcLogo = \"\"\n\t)\n\tif a.cfg.Security.OIDC.Enabled {\n\t\t// Defaults.\n\t\toidcProviderName = a.cfg.Security.OIDC.ProviderName\n\t\toidcLogo = \"oidc.png\"\n\n\t\tu, err := url.Parse(a.cfg.Security.OIDC.ProviderURL)\n\t\tif err == nil {\n\t\t\th := strings.Split(u.Hostname(), \".\")\n\n\t\t\t// Get the last two h for the root domain\n\t\t\tprov := \"\"\n\t\t\tif len(h) >= 2 {\n\t\t\t\tprov = h[len(h)-2] + \".\" + h[len(h)-1]\n\t\t\t} else {\n\t\t\t\tprov = u.Hostname()\n\t\t\t}\n\n\t\t\tif oidcProviderName == \"\" {\n\t\t\t\toidcProviderName = prov\n\t\t\t}\n\n\t\t\t// Lookup the logo in the known providers map.\n\t\t\tif _, ok := oidcProviders[prov]; ok {\n\t\t\t\toidcLogo = prov + \".png\"\n\t\t\t}\n\t\t}\n\t}\n\n\tout := loginTpl{\n\t\tTitle: a.i18n.T(\"users.login\"),\n\t\tPasswordEnabled: true,\n\t\tOIDCProvider: oidcProviderName,\n\t\tOIDCProviderLogo: oidcLogo,\n\t\tNextURI: next,\n\t}\n\n\t// If there was an error in the previous state (POST reqest), set it to render in the template.\n\tif loginErr != nil {\n\t\tif e, ok := loginErr.(*echo.HTTPError); ok {\n\t\t\tout.Error = e.Message.(string)\n\t\t} else {\n\t\t\tout.Error = loginErr.Error()\n\t\t}\n\t}\n\n\t// Generate and set a nonce for preventing CSRF requests that will be valided in the subsequent requests.\n\tnonce, err := utils.GenerateRandomString(16)\n\tif err != nil {\n\t\ta.log.Printf(\"error generating OIDC nonce: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\tc.SetCookie(&http.Cookie{\n\t\tName: \"nonce\",\n\t\tValue: nonce,\n\t\tHttpOnly: true,\n\t\tPath: \"/\",\n\t\tSameSite: http.SameSiteLaxMode,\n\t})\n\tout.Nonce = nonce\n\n\t// Render the login page.\n\treturn c.Render(http.StatusOK, \"admin-login\", out)\n}\n\n// renderLoginSetupPage renders the first time user setup page.\nfunc (a *App) renderLoginSetupPage(c echo.Context, loginErr error) error {\n\tnext := utils.SanitizeURI(c.FormValue(\"next\"))\n\tif next == \"/\" {\n\t\tnext = uriAdmin\n\t}\n\n\tout := loginTpl{\n\t\tTitle: a.i18n.T(\"users.login\"),\n\t\tPasswordEnabled: true,\n\t\tNextURI: next,\n\t}\n\n\t// If there was an error in the previous state (POST reqest), set it to render in the template.\n\tif loginErr != nil {\n\t\tif e, ok := loginErr.(*echo.HTTPError); ok {\n\t\t\tout.Error = e.Message.(string)\n\t\t} else {\n\t\t\tout.Error = loginErr.Error()\n\t\t}\n\t}\n\n\treturn c.Render(http.StatusOK, \"admin-login-setup\", out)\n}\n\n// createOIDCUser creates a new user in the DB with the OIDC claims.\nfunc (a *App) createOIDCUser(claims auth.OIDCclaim, c echo.Context) (auth.User, error) {\n\tname := claims.Name\n\tif name == \"\" {\n\t\tname = strings.TrimSpace(claims.PreferredUsername)\n\t}\n\tif name == \"\" {\n\t\tname = strings.Split(claims.Email, \"@\")[0]\n\t}\n\n\tvar listRoleID *int\n\tif a.cfg.Security.OIDC.DefaultListRoleID > 0 {\n\t\tlistRoleID = &a.cfg.Security.OIDC.DefaultListRoleID\n\t}\n\n\tuser, err := a.core.CreateUser(auth.User{\n\t\tType: auth.UserTypeUser,\n\t\tHasPassword: false,\n\t\tPasswordLogin: false,\n\t\tUsername: claims.Email,\n\t\tName: name,\n\t\tEmail: null.NewString(claims.Email, true),\n\t\tUserRoleID: a.cfg.Security.OIDC.DefaultUserRoleID,\n\t\tListRoleID: listRoleID,\n\t\tStatus: auth.UserStatusEnabled,\n\t})\n\n\treturn user, err\n}\n\n// doLogin logs a user in with a username and password.\nfunc (a *App) doLogin(c echo.Context) error {\n\tvar (\n\t\tstartTime = time.Now()\n\t\tusername = strings.TrimSpace(c.FormValue(\"username\"))\n\t\tpassword = strings.TrimSpace(c.FormValue(\"password\"))\n\t)\n\n\t// Ensure timing mitigation is applied regardless of early returns\n\tdefer func() {\n\t\tif elapsed := time.Since(startTime).Milliseconds(); elapsed < 100 {\n\t\t\ttime.Sleep(time.Duration(100-elapsed) * time.Millisecond)\n\t\t}\n\t}()\n\n\tif !strHasLen(username, 3, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"username\"))\n\t}\n\tif !strHasLen(password, 8, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t}\n\n\t// Log the user in by fetching and verifying credentials from the DB.\n\tuser, err := a.core.LoginUser(username, password)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// If TOTP is enabled for the user, create a temp token and redirect to the 2FA page.\n\tif user.TwofaType == models.TwofaTypeTOTP {\n\t\t// Generate a random token.\n\t\ttoken, err := generateRandomString(tmpAuthTokenLen)\n\t\tif err != nil {\n\t\t\ta.log.Printf(\"error generating 2FA token: %v\", err)\n\t\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t\t}\n\n\t\t// Set the token.\n\t\ttmptokens.Set(token, twofaTokenTTL, user.ID)\n\n\t\t// Redirect to 2FA page.\n\t\tnext := utils.SanitizeURI(c.FormValue(\"next\"))\n\t\treturn c.Redirect(http.StatusFound, fmt.Sprintf(\"%s/login/twofa?token=%s&next=%s\", uriAdmin, token, url.QueryEscape(next)))\n\t}\n\n\t// Set the session in the DB and cookie.\n\tif err := a.auth.SaveSession(user, \"\", c); err != nil {\n\t\treturn err\n\t}\n\n\treturn nil\n}\n\n// doFirstTimeSetup sets a user up for the first time.\nfunc (a *App) doFirstTimeSetup(c echo.Context) error {\n\tvar (\n\t\temail = strings.TrimSpace(c.FormValue(\"email\"))\n\t\tusername = strings.TrimSpace(c.FormValue(\"username\"))\n\t\tpassword = strings.TrimSpace(c.FormValue(\"password\"))\n\t\tpassword2 = strings.TrimSpace(c.FormValue(\"password2\"))\n\t)\n\tif !utils.ValidateEmail(email) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"email\"))\n\t}\n\tif !strHasLen(username, 3, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"username\"))\n\t}\n\tif !strHasLen(password, 8, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t}\n\tif password != password2 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"users.passwordMismatch\"))\n\t}\n\n\t// Create the default \"Super Admin\" with all permissions if it doesn't exist.\n\tif _, err := a.core.GetRole(auth.SuperAdminRoleID); err != nil {\n\t\tr := auth.Role{\n\t\t\tType: auth.RoleTypeUser,\n\t\t\tName: null.NewString(\"Super Admin\", true),\n\t\t}\n\t\tfor p := range a.cfg.Permissions {\n\t\t\tr.Permissions = append(r.Permissions, p)\n\t\t}\n\n\t\t// Create the role in the DB.\n\t\tif _, err := a.core.CreateRole(r); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\t// Create the super admin user in the DB.\n\tu := auth.User{\n\t\tType: auth.UserTypeUser,\n\t\tHasPassword: true,\n\t\tPasswordLogin: true,\n\t\tUsername: username,\n\t\tName: username,\n\t\tPassword: null.NewString(password, true),\n\t\tEmail: null.NewString(email, true),\n\t\tUserRoleID: auth.SuperAdminRoleID,\n\t\tStatus: auth.UserStatusEnabled,\n\t}\n\tif _, err := a.core.CreateUser(u); err != nil {\n\t\treturn err\n\t}\n\n\t// Log the user in directly.\n\tuser, err := a.core.LoginUser(username, password)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Set the session in the DB and cookie.\n\tif err := a.auth.SaveSession(user, \"\", c); err != nil {\n\t\treturn err\n\t}\n\n\treturn nil\n}\n\n// renderResetPasswordPage renders the reset password page.\nfunc (a *App) renderResetPasswordPage(c echo.Context, token, email, errMsg string) error {\n\tout := resetPasswordTpl{\n\t\tTitle: a.i18n.T(\"users.resetPassword\"),\n\t\tToken: token,\n\t\tEmail: email,\n\t\tError: errMsg,\n\t}\n\treturn c.Render(http.StatusOK, \"admin-reset-password\", out)\n}\n\n// doForgotPassword handles the forgot password form submission.\nfunc (a *App) doForgotPassword(c echo.Context) error {\n\tvar (\n\t\temail = strings.ToLower(strings.TrimSpace(c.FormValue(\"email\")))\n\t)\n\n\t// Validate email format.\n\tif !utils.ValidateEmail(email) {\n\t\treturn c.Render(http.StatusOK, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.resetLinkSent\")))\n\t}\n\n\t// Get the user by email.\n\tuser, err := a.core.GetUser(0, \"\", email)\n\tif err != nil {\n\t\treturn c.Render(http.StatusOK, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.resetLinkSent\")))\n\t}\n\n\t// If the password login is disabled, do not proceed, but show success message to prevent email enumeration.\n\tif !user.PasswordLogin {\n\t\treturn c.Render(http.StatusOK, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.resetLinkSent\")))\n\t}\n\n\t// Generate a random token.\n\ttoken, err := generateRandomString(tmpAuthTokenLen)\n\tif err != nil {\n\t\ta.log.Printf(\"error generating reset token: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\n\t// Store the reset token in tmptokens.\n\ttmptokens.Set(email, passwordResetTTL, token)\n\n\t// Prepare the reset URL.\n\tresetURL := fmt.Sprintf(\"%s/admin/reset?token=%s&email=%s\", a.urlCfg.RootURL, token, url.QueryEscape(email))\n\n\t// Prepare the email.\n\tvar msg bytes.Buffer\n\tdata := struct {\n\t\tResetURL string\n\t\tL *i18n.I18n\n\t}{\n\t\tResetURL: resetURL,\n\t\tL: a.i18n,\n\t}\n\n\t// Render the email template.\n\tif err := notifs.Tpls.ExecuteTemplate(&msg, notifs.TplForgotPassword, data); err != nil {\n\t\ta.log.Printf(\"error compiling notification template '%s': %v\", notifs.TplForgotPassword, err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\n\tsubject, body := notifs.GetTplSubject(a.i18n.T(\"email.forgotPassword.subject\"), msg.Bytes())\n\n\t// Send the email.\n\tif err := a.emailMsgr.Push(models.Message{\n\t\tFrom: a.cfg.FromEmail,\n\t\tTo: []string{email},\n\t\tSubject: subject,\n\t\tBody: body,\n\t}); err != nil {\n\t\ta.log.Printf(\"error sending reset email: %s\", err)\n\t}\n\n\t// Show the success e-mail nonetheless to prevent e-mail enumeration.\n\treturn c.Render(http.StatusOK, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.resetLinkSent\")))\n}\n\n// doResetPassword handles the reset password form submission.\nfunc (a *App) doResetPassword(c echo.Context, token, email string) error {\n\tvar (\n\t\tpassword = c.FormValue(\"password\")\n\t\tpassword2 = c.FormValue(\"password2\")\n\t)\n\n\t// Validate password.\n\tif !strHasLen(password, 8, stdInputMaxLen) {\n\t\treturn a.renderResetPasswordPage(c, token, email, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t}\n\tif password != password2 {\n\t\treturn a.renderResetPasswordPage(c, token, email, a.i18n.T(\"users.passwordMismatch\"))\n\t}\n\n\t// Validate and consume the token (this deletes it).\n\tdata, err := tmptokens.Get(email)\n\tif err != nil {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.invalidResetLink\")))\n\t}\n\n\ttk, ok := data.(string)\n\tif !ok || tk != token {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.invalidResetLink\")))\n\t}\n\n\t// Get the user.\n\tuser, err := a.core.GetUser(0, \"\", email)\n\tif err != nil {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"users.invalidResetLink\")))\n\t}\n\n\t// Password login is disabled for the user.\n\tif !user.PasswordLogin {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage, makeMsgTpl(a.i18n.T(\"users.resetPassword\"), \"\", a.i18n.T(\"public.invalidFeature\")))\n\t}\n\n\tuser.Password = null.NewString(password, true)\n\tif _, err := a.core.UpdateUserProfile(user.ID, user); err != nil {\n\t\ta.log.Printf(\"error updating user password: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\n\t// Log the user in directly without forcing a manual login right after password change.\n\tif err := a.auth.SaveSession(user, \"\", c); err != nil {\n\t\treturn err\n\t}\n\n\t// Redirect to the admin page.\n\treturn c.Redirect(http.StatusFound, uriAdmin)\n}\n\n// renderTwofaPage renders the 2FA verification page.\nfunc (a *App) renderTwofaPage(c echo.Context, token, next, errMsg string) error {\n\tout := twofaTpl{\n\t\tTitle: a.i18n.T(\"users.twoFA\"),\n\t\tDescription: \"\",\n\t\tToken: token,\n\t\tNextURI: next,\n\t\tError: errMsg,\n\t}\n\treturn c.Render(http.StatusOK, \"admin-twofa\", out)\n}\n\n// doTwofaVerify handles the 2FA verification form submission.\nfunc (a *App) doTwofaVerify(c echo.Context, token string, userID int, next string) error {\n\ttotpCode := strings.TrimSpace(c.FormValue(\"totp_code\"))\n\n\t// Validate.\n\tif !strHasLen(totpCode, 6, 6) {\n\t\treturn a.renderTwofaPage(c, token, next, a.i18n.T(\"globals.messages.invalidValue\"))\n\t}\n\n\t// Get the user.\n\tuser, err := a.core.GetUser(userID, \"\", \"\")\n\tif err != nil {\n\t\treturn a.renderTwofaPage(c, token, next, a.i18n.T(\"users.invalidRequest\"))\n\t}\n\n\t// Verify that TOTP is actually enabled for the user.\n\tif user.TwofaType != models.TwofaTypeTOTP {\n\t\treturn a.renderTwofaPage(c, token, next, a.i18n.T(\"users.twoFANotEnabled\"))\n\t}\n\n\t// Verify the TOTP code.\n\tvalid := totp.Validate(totpCode, user.TwofaKey.String)\n\tif !valid {\n\t\treturn a.renderTwofaPage(c, token, next, a.i18n.T(\"globals.messages.invalidValue\"))\n\t}\n\n\t// Invalidate the token.\n\ttmptokens.Delete(token)\n\n\t// Set the session.\n\tif err := a.auth.SaveSession(user, \"\", c); err != nil {\n\t\treturn err\n\t}\n\n\t// Redirect to the next page.\n\treturn c.Redirect(http.StatusFound, next)\n}\n\n// GenerateTOTPQR generates a TOTP QR code for a user to scan with their authenticator app.\nfunc (a *App) GenerateTOTPQR(c echo.Context) error {\n\tu := c.Get(auth.UserHTTPCtxKey).(auth.User)\n\n\t// If TOTP is already enabled, don't generate a new key.\n\tif u.TwofaType == models.TwofaTypeTOTP {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"users.twoFAAlreadyEnabled\"))\n\t}\n\n\t// Generate a new TOTP key.\n\tkey, err := totp.Generate(totp.GenerateOpts{\n\t\tIssuer: a.cfg.SiteName,\n\t\tAccountName: u.Email.String,\n\t})\n\tif err != nil {\n\t\ta.log.Printf(\"error generating TOTP key: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\n\t// Convert the TOTP key to a QR code image.\n\timg, err := key.Image(200, 200)\n\tif err != nil {\n\t\ta.log.Printf(\"error generating QR code: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\n\t// Encode the QR code as a PNG and return it as base64.\n\tvar buf bytes.Buffer\n\tif err := png.Encode(&buf, img); err != nil {\n\t\ta.log.Printf(\"error encoding QR code: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{struct {\n\t\tSecret string `json:\"secret\"`\n\t\tQR string `json:\"qr\"`\n\t}{\n\t\tSecret: key.Secret(),\n\t\tQR: base64.StdEncoding.EncodeToString(buf.Bytes()),\n\t}})\n}\n"
},
{
"path": "cmd/bounce.go",
"content": "package main\n\nimport (\n\t\"encoding/json\"\n\t\"io\"\n\t\"net/http\"\n\t\"strconv\"\n\t\"time\"\n\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n)\n\n// GetBounce handles retrieval of a specific bounce record by ID.\nfunc (a *App) GetBounce(c echo.Context) error {\n\t// Fetch one bounce from the DB.\n\tid := getID(c)\n\tout, err := a.core.GetBounce(id)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetBounces handles retrieval of bounce records.\nfunc (a *App) GetBounces(c echo.Context) error {\n\tvar (\n\t\tcampID, _ = strconv.Atoi(c.QueryParam(\"campaign_id\"))\n\t\tsource = c.FormValue(\"source\")\n\t\torderBy = c.FormValue(\"order_by\")\n\t\torder = c.FormValue(\"order\")\n\n\t\tpg = a.pg.NewFromURL(c.Request().URL.Query())\n\t)\n\n\t// Query and fetch bounces from the DB.\n\tres, total, err := a.core.QueryBounces(campID, 0, source, orderBy, order, pg.Offset, pg.Limit)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// No results.\n\tif len(res) == 0 {\n\t\treturn c.JSON(http.StatusOK, okResp{models.PageResults{Results: []models.Bounce{}}})\n\t}\n\n\tout := models.PageResults{\n\t\tResults: res,\n\t\tTotal: total,\n\t\tPage: pg.Page,\n\t\tPerPage: pg.PerPage,\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetSubscriberBounces retrieves a subscriber's bounce records.\nfunc (a *App) GetSubscriberBounces(c echo.Context) error {\n\t// Query and fetch bounces from the DB.\n\tsubID := getID(c)\n\tout, _, err := a.core.QueryBounces(0, subID, \"\", \"\", \"\", 0, 1000)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// DeleteBounces handles bounce deletion of a list.\nfunc (a *App) DeleteBounces(c echo.Context) error {\n\tall, _ := strconv.ParseBool(c.QueryParam(\"all\"))\n\n\tvar ids []int\n\tif !all {\n\t\t// There are multiple IDs in the query string.\n\t\tres, err := parseStringIDs(c.Request().URL.Query()[\"id\"])\n\t\tif err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidID\", \"error\", err.Error()))\n\t\t}\n\t\tif len(res) == 0 {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidID\"))\n\t\t}\n\n\t\tids = res\n\t}\n\n\t// Delete bounces from the DB.\n\tif err := a.core.DeleteBounces(ids, all); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DeleteBounce handles bounce deletion of a single bounce record.\nfunc (a *App) DeleteBounce(c echo.Context) error {\n\t// Delete bounces from the DB.\n\tid := getID(c)\n\tif err := a.core.DeleteBounces([]int{id}, false); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// BlocklistBouncedSubscribers handles blocklisting of all bounced subscribers.\nfunc (a *App) BlocklistBouncedSubscribers(c echo.Context) error {\n\tif err := a.core.BlocklistBouncedSubscribers(); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// BounceWebhook renders the HTML preview of a template.\nfunc (a *App) BounceWebhook(c echo.Context) error {\n\t// Read the request body instead of using c.Bind() to read to save the entire raw request as meta.\n\trawReq, err := io.ReadAll(c.Request().Body)\n\tif err != nil {\n\t\ta.log.Printf(\"error reading ses notification body: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.internalError\"))\n\t}\n\n\tvar (\n\t\tservice = c.Param(\"service\")\n\n\t\tbounces []models.Bounce\n\t)\n\tswitch true {\n\t// Native internal webhook.\n\tcase service == \"\":\n\t\tvar b models.Bounce\n\t\tif err := json.Unmarshal(rawReq, &b); err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidData\")+\":\"+err.Error())\n\t\t}\n\n\t\tif bv, err := a.validateBounceFields(b); err != nil {\n\t\t\treturn err\n\t\t} else {\n\t\t\tb = bv\n\t\t}\n\n\t\tif len(b.Meta) == 0 {\n\t\t\tb.Meta = json.RawMessage(\"{}\")\n\t\t}\n\n\t\tif b.CreatedAt.Year() == 0 {\n\t\t\tb.CreatedAt = time.Now()\n\t\t}\n\n\t\tbounces = append(bounces, b)\n\n\t// Amazon SES.\n\tcase service == \"ses\" && a.cfg.BounceSESEnabled:\n\t\tswitch c.Request().Header.Get(\"X-Amz-Sns-Message-Type\") {\n\t\t// SNS webhook registration confirmation. Only after these are processed will the endpoint\n\t\t// start getting bounce notifications.\n\t\tcase \"SubscriptionConfirmation\", \"UnsubscribeConfirmation\":\n\t\t\tif err := a.bounce.SES.ProcessSubscription(rawReq); err != nil {\n\t\t\t\ta.log.Printf(\"error processing SNS (SES) subscription: %v\", err)\n\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t\t\t}\n\n\t\t// Bounce notification.\n\t\tcase \"Notification\":\n\t\t\tb, err := a.bounce.SES.ProcessBounce(rawReq)\n\t\t\tif err != nil {\n\t\t\t\ta.log.Printf(\"error processing SES notification: %v\", err)\n\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t\t\t}\n\t\t\tbounces = append(bounces, b)\n\n\t\tdefault:\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t\t}\n\n\t// SendGrid.\n\tcase service == \"sendgrid\" && a.cfg.BounceSendgridEnabled:\n\t\tvar (\n\t\t\tsig = c.Request().Header.Get(\"X-Twilio-Email-Event-Webhook-Signature\")\n\t\t\tts = c.Request().Header.Get(\"X-Twilio-Email-Event-Webhook-Timestamp\")\n\t\t)\n\n\t\t// Sendgrid sends multiple bounces.\n\t\tbs, err := a.bounce.Sendgrid.ProcessBounce(sig, ts, rawReq)\n\t\tif err != nil {\n\t\t\ta.log.Printf(\"error processing sendgrid notification: %v\", err)\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t\t}\n\t\tbounces = append(bounces, bs...)\n\n\t// Postmark.\n\tcase service == \"postmark\" && a.cfg.BouncePostmarkEnabled:\n\t\tbs, err := a.bounce.Postmark.ProcessBounce(rawReq, c)\n\t\tif err != nil {\n\t\t\ta.log.Printf(\"error processing postmark notification: %v\", err)\n\t\t\tif _, ok := err.(*echo.HTTPError); ok {\n\t\t\t\treturn err\n\t\t\t}\n\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t\t}\n\t\tbounces = append(bounces, bs...)\n\n\t// ForwardEmail.\n\tcase service == \"forwardemail\" && a.cfg.BounceForwardemailEnabled:\n\t\tvar (\n\t\t\tsig = c.Request().Header.Get(\"X-Webhook-Signature\")\n\t\t)\n\n\t\tbs, err := a.bounce.Forwardemail.ProcessBounce(sig, rawReq)\n\t\tif err != nil {\n\t\t\ta.log.Printf(\"error processing forwardemail notification: %v\", err)\n\t\t\tif _, ok := err.(*echo.HTTPError); ok {\n\t\t\t\treturn err\n\t\t\t}\n\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t\t}\n\t\tbounces = append(bounces, bs...)\n\n\tdefault:\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"bounces.unknownService\"))\n\t}\n\n\t// Insert bounces into the DB.\n\tfor _, b := range bounces {\n\t\tif err := a.bounce.Record(b); err != nil {\n\t\t\ta.log.Printf(\"error recording bounce: %v\", err)\n\t\t}\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\nfunc (a *App) validateBounceFields(b models.Bounce) (models.Bounce, error) {\n\tif b.Email == \"\" && b.SubscriberUUID == \"\" {\n\t\treturn b, echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"email / subscriber_uuid\"))\n\t}\n\n\tif b.SubscriberUUID != \"\" && !reUUID.MatchString(b.SubscriberUUID) {\n\t\treturn b, echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"subscriber_uuid\"))\n\t}\n\n\tif b.Email != \"\" {\n\t\tem, err := a.importer.SanitizeEmail(b.Email)\n\t\tif err != nil {\n\t\t\treturn b, echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t\t}\n\t\tb.Email = em\n\t}\n\n\tif b.Type != models.BounceTypeHard && b.Type != models.BounceTypeSoft && b.Type != models.BounceTypeComplaint {\n\t\treturn b, echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"type\"))\n\t}\n\n\treturn b, nil\n}\n"
},
{
"path": "cmd/campaigns.go",
"content": "package main\n\nimport (\n\t\"bytes\"\n\t\"encoding/json\"\n\t\"errors\"\n\t\"fmt\"\n\t\"html/template\"\n\t\"net/http\"\n\t\"net/url\"\n\t\"regexp\"\n\t\"strconv\"\n\t\"strings\"\n\t\"time\"\n\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/internal/notifs\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n\t\"github.com/lib/pq\"\n\t\"gopkg.in/volatiletech/null.v6\"\n)\n\n// campReq is a wrapper over the Campaign model for receiving\n// campaign creation and update data from APIs.\ntype campReq struct {\n\tmodels.Campaign\n\n\t// This overrides Campaign.Lists to receive and\n\t// write a list of int IDs during creation and updation.\n\t// Campaign.Lists is JSONText for sending lists children\n\t// to the outside world.\n\tListIDs []int `json:\"lists\"`\n\n\tMediaIDs []int `json:\"media\"`\n\n\t// This is only relevant to campaign test requests.\n\tSubscriberEmails pq.StringArray `json:\"subscribers\"`\n}\n\n// campContentReq wraps params coming from API requests for converting\n// campaign content formats.\ntype campContentReq struct {\n\tmodels.Campaign\n\tFrom string `json:\"from\"`\n\tTo string `json:\"to\"`\n}\n\nvar (\n\treFromAddress = regexp.MustCompile(`((.+?)\\s)?<(.+?)@(.+?)>`)\n\treSlug = regexp.MustCompile(`[^\\p{L}\\p{M}\\p{N}]`)\n)\n\n// GetCampaigns handles retrieval of campaigns.\nfunc (a *App) GetCampaigns(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\tvar (\n\t\thasAllPerm = user.HasPerm(auth.PermCampaignsGetAll)\n\t\tpermittedLists []int\n\t)\n\n\tif !hasAllPerm {\n\t\t// Either the user has campaigns:get_all permissions and can view all campaigns,\n\t\t// or the campaigns are filtered by the lists the user has get|manage access to.\n\t\thasAllPerm, permittedLists = user.GetPermittedLists(auth.PermTypeGet | auth.PermTypeManage)\n\t}\n\n\tvar (\n\t\tpg = a.pg.NewFromURL(c.Request().URL.Query())\n\n\t\tstatus = c.QueryParams()[\"status\"]\n\t\ttags = c.QueryParams()[\"tag\"]\n\t\tquery = strings.TrimSpace(c.FormValue(\"query\"))\n\t\torderBy = c.FormValue(\"order_by\")\n\t\torder = c.FormValue(\"order\")\n\t\tnoBody, _ = strconv.ParseBool(c.QueryParam(\"no_body\"))\n\t)\n\n\t// Query and retrieve campaigns from the DB.\n\tres, total, err := a.core.QueryCampaigns(query, status, tags, orderBy, order, hasAllPerm, permittedLists, pg.Offset, pg.Limit)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Remove the body from the response if requested.\n\tif noBody {\n\t\tfor i := range res {\n\t\t\tres[i].Body = \"\"\n\t\t\tres[i].BodySource.Valid = false\n\t\t}\n\t}\n\n\t// Paginate the response.\n\tif len(res) == 0 {\n\t\treturn c.JSON(http.StatusOK, okResp{models.PageResults{Results: []models.Campaign{}}})\n\t}\n\n\tout := models.PageResults{\n\t\tQuery: query,\n\t\tResults: res,\n\t\tTotal: total,\n\t\tPage: pg.Page,\n\t\tPerPage: pg.PerPage,\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetCampaign handles retrieval of campaigns.\nfunc (a *App) GetCampaign(c echo.Context) error {\n\t// Get the campaign ID.\n\tid := getID(c)\n\n\t// Check if the user has access to the campaign.\n\tif err := a.checkCampaignPerm(auth.PermTypeGet, id, c); err != nil {\n\t\treturn err\n\t}\n\n\t// Get the campaign from the DB.\n\tout, err := a.core.GetCampaign(id, \"\", \"\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Blank out the body if requested.\n\tnoBody, _ := strconv.ParseBool(c.QueryParam(\"no_body\"))\n\tif noBody {\n\t\tout.Body = \"\"\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// PreviewCampaign renders the HTML preview of a campaign body.\nfunc (a *App) PreviewCampaign(c echo.Context) error {\n\t// Get the campaign ID.\n\tid := getID(c)\n\n\t// Check if the user has access to the campaign.\n\tif err := a.checkCampaignPerm(auth.PermTypeGet, id, c); err != nil {\n\t\treturn err\n\t}\n\n\tvar (\n\t\tisPost = c.Request().Method == http.MethodPost\n\t\tcontentType = c.FormValue(\"content_type\")\n\t\ttplID, _ = strconv.Atoi(c.FormValue(\"template_id\"))\n\t)\n\t// For visual content, template ID for previewing is irrelevant.\n\tif contentType == models.CampaignContentTypeVisual || tplID < 1 {\n\t\ttplID = 0\n\t}\n\n\t// Get the campaign from the DB for previewing with the `template_body` field.\n\tcamp, err := a.core.GetCampaignForPreview(id, tplID)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// There's a body in the request to preview instead of the body in the DB.\n\tif isPost {\n\t\tcamp.ContentType = contentType\n\t\tcamp.Body = c.FormValue(\"body\")\n\n\t\t// For visual campaigns, template body from the DB shouldn't be used.\n\t\tif contentType == models.CampaignContentTypeVisual {\n\t\t\tcamp.TemplateBody = \"\"\n\t\t}\n\t}\n\n\t// Use a dummy campaign ID to prevent views and clicks from {{ TrackView }}\n\t// and {{ TrackLink }} being registered on preview.\n\tcamp.UUID = dummySubscriber.UUID\n\tif err := camp.CompileTemplate(a.manager.TemplateFuncs(&camp)); err != nil {\n\t\ta.log.Printf(\"error compiling template: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"templates.errorCompiling\", \"error\", err.Error()))\n\t}\n\n\t// Render the message body.\n\tmsg, err := a.manager.NewCampaignMessage(&camp, dummySubscriber)\n\tif err != nil {\n\t\ta.log.Printf(\"error rendering message: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"templates.errorRendering\", \"error\", err.Error()))\n\t}\n\n\t// Plaintext headers for plain body.\n\tif camp.ContentType == models.CampaignContentTypePlain {\n\t\treturn c.String(http.StatusOK, string(msg.Body()))\n\t}\n\n\treturn c.HTML(http.StatusOK, string(msg.Body()))\n}\n\n// PreviewCampaignArchive renders the public campaign archives page.\nfunc (a *App) PreviewCampaignArchive(c echo.Context) error {\n\t// Get the campaign ID.\n\tid := getID(c)\n\n\t// Check if the user has access to the campaign.\n\tif err := a.checkCampaignPerm(auth.PermTypeGet, id, c); err != nil {\n\t\treturn err\n\t}\n\n\t// Fetch the campaign body from the DB.\n\ttplID, _ := strconv.Atoi(c.FormValue(\"template_id\"))\n\tcamp, err := a.core.GetCampaignForPreview(id, tplID)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tcamp.ArchiveMeta = json.RawMessage([]byte(c.FormValue(\"archive_meta\")))\n\n\t// \"Compile\" the campaign template with appropriate data.\n\tres, err := a.compileArchiveCampaigns([]models.Campaign{camp})\n\tif err != nil {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\t// Render the campaign body.\n\tout := res[0].Campaign\n\tmsg, err := a.manager.NewCampaignMessage(out, res[0].Subscriber)\n\tif err != nil {\n\t\ta.log.Printf(\"error rendering campaign: %v\", err)\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\treturn c.HTML(http.StatusOK, string(msg.Body()))\n}\n\n// CampaignContent handles campaign content (body) format conversions.\nfunc (a *App) CampaignContent(c echo.Context) error {\n\tvar camp campContentReq\n\tif err := c.Bind(&camp); err != nil {\n\t\treturn err\n\t}\n\n\t// Convert formats, eg: markdown to HTML.\n\tout, err := camp.ConvertContent(camp.From, camp.To)\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// CreateCampaign handles campaign creation.\n// Newly created campaigns are always drafts.\nfunc (a *App) CreateCampaign(c echo.Context) error {\n\tvar o campReq\n\tif err := c.Bind(&o); err != nil {\n\t\treturn err\n\t}\n\n\t// Filter lists against the current user's permitted lists.\n\tuser := auth.GetUser(c)\n\to.ListIDs = user.FilterListsByPerm(auth.PermTypeGet|auth.PermTypeManage, o.ListIDs)\n\n\t// If the campaign's 'opt-in', prepare a default message.\n\tswitch o.Type {\n\tcase models.CampaignTypeOptin:\n\t\top, err := a.makeOptinCampaignMessage(o)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\to = op\n\tcase \"\":\n\t\to.Type = models.CampaignTypeRegular\n\t}\n\n\tif o.Messenger == \"\" {\n\t\to.Messenger = \"email\"\n\t}\n\n\t// Validate.\n\tif c, err := a.validateCampaignFields(o); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t} else {\n\t\to = c\n\t}\n\n\tif o.ArchiveTemplateID.Valid && o.ArchiveTemplateID.Int != 0 {\n\t\to.ArchiveTemplateID = o.TemplateID\n\t}\n\n\tout, err := a.core.CreateCampaign(o.Campaign, o.ListIDs, o.MediaIDs)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// UpdateCampaign handles campaign modification.\n// Campaigns that are done cannot be modified.\nfunc (a *App) UpdateCampaign(c echo.Context) error {\n\t// Get the campaign ID.\n\tid := getID(c)\n\n\t// Check if the user has access to the campaign.\n\tif err := a.checkCampaignPerm(auth.PermTypeManage, id, c); err != nil {\n\t\treturn err\n\t}\n\n\t// Retrieve the campaign from the DB.\n\tcm, err := a.core.GetCampaign(id, \"\", \"\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tif !canEditCampaign(cm.Status) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"campaigns.cantUpdate\"))\n\t}\n\n\t// Clear attribs to avoid merging old and new values as json.Unmarshal in JSON.scan() merges maps,\n\t// merging values already in the DB and incoming values. If this is nil, then DB values remain\n\t// unchanged.\n\tcm.Attribs = nil\n\n\t// Read the incoming params into the existing campaign fields from the DB.\n\t// This allows updating of values that have been sent whereas fields\n\t// that are not in the request retain the old values.\n\to := campReq{Campaign: cm}\n\tif err := c.Bind(&o); err != nil {\n\t\treturn err\n\t}\n\n\tif c, err := a.validateCampaignFields(o); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t} else {\n\t\to = c\n\t}\n\n\tout, err := a.core.UpdateCampaign(id, o.Campaign, o.ListIDs, o.MediaIDs)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// UpdateCampaignStatus handles campaign status modification.\nfunc (a *App) UpdateCampaignStatus(c echo.Context) error {\n\t// Get the campaign ID.\n\tid := getID(c)\n\n\t// Check if the user has access to the campaign.\n\tif err := a.checkCampaignPerm(auth.PermTypeManage, id, c); err != nil {\n\t\treturn err\n\t}\n\n\treq := struct {\n\t\tStatus string `json:\"status\"`\n\t}{}\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\n\t// Update the campaign status in the DB.\n\tout, err := a.core.UpdateCampaignStatus(id, req.Status)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// If the campaign is being stopped, send the signal to the manager to stop it in flight.\n\tif req.Status == models.CampaignStatusPaused || req.Status == models.CampaignStatusCancelled {\n\t\ta.manager.StopCampaign(id)\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// UpdateCampaignArchive handles campaign status modification.\nfunc (a *App) UpdateCampaignArchive(c echo.Context) error {\n\tid := getID(c)\n\n\t// Check if the user has access to the campaign.\n\tif err := a.checkCampaignPerm(auth.PermTypeManage, id, c); err != nil {\n\t\treturn err\n\t}\n\n\treq := struct {\n\t\tArchive bool `json:\"archive\"`\n\t\tTemplateID int `json:\"archive_template_id\"`\n\t\tMeta models.JSON `json:\"archive_meta\"`\n\t\tArchiveSlug string `json:\"archive_slug\"`\n\t}{}\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\n\tif req.ArchiveSlug != \"\" {\n\t\t// Format the slug to be alpha-numeric-dash.\n\t\ts := strings.ToLower(req.ArchiveSlug)\n\t\ts = strings.TrimSpace(reSlug.ReplaceAllString(s, \" \"))\n\t\ts = regexpSpaces.ReplaceAllString(s, \"-\")\n\t\treq.ArchiveSlug = s\n\t}\n\n\tif err := a.core.UpdateCampaignArchive(id, req.Archive, req.TemplateID, req.Meta, req.ArchiveSlug); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{req})\n}\n\n// DeleteCampaign handles campaign deletion.\n// Only scheduled campaigns that have not started yet can be deleted.\nfunc (a *App) DeleteCampaign(c echo.Context) error {\n\t// Get the campaign ID.\n\tid := getID(c)\n\n\t// Check if the user has access to the campaign.\n\tif err := a.checkCampaignPerm(auth.PermTypeManage, id, c); err != nil {\n\t\treturn err\n\t}\n\n\t// Delete the campaign from the DB.\n\tif err := a.core.DeleteCampaign(id); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DeleteCampaigns deletes multiple campaigns by IDs or by query.\nfunc (a *App) DeleteCampaigns(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\tvar (\n\t\thasAllPerm = user.HasPerm(auth.PermCampaignsManageAll)\n\t\tpermittedLists []int\n\t)\n\n\tif !hasAllPerm {\n\t\t// Either the user has campaigns:manage_all permissions and can manage all campaigns,\n\t\t// or the campaigns are filtered by the lists the user has get|manage access to.\n\t\thasAllPerm, permittedLists = user.GetPermittedLists(auth.PermTypeGet | auth.PermTypeManage)\n\t}\n\n\tvar (\n\t\tids []int\n\t\tquery string\n\t\tall bool\n\t)\n\n\t// Check for IDs in query params.\n\tif len(c.Request().URL.Query()[\"id\"]) > 0 {\n\t\tvar err error\n\t\tids, err = parseStringIDs(c.Request().URL.Query()[\"id\"])\n\t\tif err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", err.Error()))\n\t\t}\n\t} else {\n\t\t// Check for query param.\n\t\tquery = strings.TrimSpace(c.FormValue(\"query\"))\n\t\tall = c.FormValue(\"all\") == \"true\"\n\t}\n\n\t// Validate that either IDs or query is provided.\n\tif len(ids) == 0 && (query == \"\" && !all) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", \"id or query required\"))\n\t}\n\n\t// Delete the campaigns from the DB.\n\tif err := a.core.DeleteCampaigns(ids, query, hasAllPerm, permittedLists); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// GetRunningCampaignStats returns stats of a given set of campaign IDs.\nfunc (a *App) GetRunningCampaignStats(c echo.Context) error {\n\t// Get the running campaign stats from the DB.\n\tout, err := a.core.GetRunningCampaignStats()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tif len(out) == 0 {\n\t\treturn c.JSON(http.StatusOK, okResp{[]struct{}{}})\n\t}\n\n\t// Compute rate.\n\tfor i, c := range out {\n\t\tif c.Started.Valid && c.UpdatedAt.Valid {\n\t\t\tdiff := max(int(c.UpdatedAt.Time.Sub(c.Started.Time).Minutes()), 1)\n\n\t\t\trate := c.Sent / diff\n\t\t\tif rate > c.Sent || rate > c.ToSend {\n\t\t\t\trate = c.Sent\n\t\t\t}\n\n\t\t\t// Rate since the starting of the campaign.\n\t\t\tout[i].NetRate = rate\n\n\t\t\t// Realtime running rate over the last minute.\n\t\t\tout[i].Rate = a.manager.GetCampaignStats(c.ID).SendRate\n\t\t}\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// TestCampaign handles the sending of a campaign message to\n// arbitrary subscribers for testing.\nfunc (a *App) TestCampaign(c echo.Context) error {\n\t// Get the campaign ID.\n\tid := getID(c)\n\n\t// Check if the user has access to the campaign.\n\tif err := a.checkCampaignPerm(auth.PermTypeManage, id, c); err != nil {\n\t\treturn err\n\t}\n\n\t// Get and validate fields.\n\tvar req campReq\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\n\t// Validate.\n\tif c, err := a.validateCampaignFields(req); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t} else {\n\t\treq = c\n\t}\n\tif len(req.SubscriberEmails) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"campaigns.noSubsToTest\"))\n\t}\n\n\t// Sanitize subscriber e-mails.\n\tfor i := range req.SubscriberEmails {\n\t\treq.SubscriberEmails[i] = strings.ToLower(strings.TrimSpace(req.SubscriberEmails[i]))\n\t}\n\n\t// Get the subscribers from the DB by their e-mails.\n\tsubs, err := a.core.GetSubscribersByEmail(req.SubscriberEmails)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Get the campaign from the DB for previewing.\n\ttplID, _ := strconv.Atoi(c.FormValue(\"template_id\"))\n\tcamp, err := a.core.GetCampaignForPreview(id, tplID)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Override certain values from the DB with incoming values.\n\tcamp.Name = req.Name\n\tcamp.Subject = req.Subject\n\tcamp.FromEmail = req.FromEmail\n\tcamp.Body = req.Body\n\tcamp.AltBody = req.AltBody\n\tcamp.Messenger = req.Messenger\n\tcamp.ContentType = req.ContentType\n\tcamp.Headers = req.Headers\n\tcamp.TemplateID = req.TemplateID\n\tfor _, id := range req.MediaIDs {\n\t\tif id > 0 {\n\t\t\tcamp.MediaIDs = append(camp.MediaIDs, int64(id))\n\t\t}\n\t}\n\n\t// Send the test messages.\n\tfor _, s := range subs {\n\t\tsub := s\n\n\t\tif err := a.sendTestMessage(sub, &camp); err != nil {\n\t\t\ta.log.Printf(\"error sending test message: %v\", err)\n\t\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\t\ta.i18n.Ts(\"campaigns.errorSendTest\", \"error\", err.Error()))\n\t\t}\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// GetCampaignViewAnalytics retrieves view counts for a campaign.\nfunc (a *App) GetCampaignViewAnalytics(c echo.Context) error {\n\tids, err := parseStringIDs(c.Request().URL.Query()[\"id\"])\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", err.Error()))\n\t}\n\n\tif len(ids) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.missingFields\", \"name\", \"`id`\"))\n\t}\n\n\tvar (\n\t\ttyp = c.Param(\"type\")\n\t\tfrom = c.QueryParams().Get(\"from\")\n\t\tto = c.QueryParams().Get(\"to\")\n\t)\n\tif !strHasLen(from, 10, 30) || !strHasLen(to, 10, 30) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"analytics.invalidDates\"))\n\t}\n\n\t// Campaign link stats.\n\tif typ == \"links\" {\n\t\tout, err := a.core.GetCampaignAnalyticsLinks(ids, typ, from, to)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\treturn c.JSON(http.StatusOK, okResp{out})\n\t}\n\n\t// Get the analytics numbers from the DB for the campaigns.\n\tout, err := a.core.GetCampaignAnalyticsCounts(ids, typ, from, to)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// sendTestMessage takes a campaign and a subscriber and sends out a sample campaign message.\nfunc (a *App) sendTestMessage(sub models.Subscriber, camp *models.Campaign) error {\n\tif err := camp.CompileTemplate(a.manager.TemplateFuncs(camp)); err != nil {\n\t\ta.log.Printf(\"error compiling template: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\ta.i18n.Ts(\"templates.errorCompiling\", \"error\", err.Error()))\n\t}\n\n\t// Create a sample campaign message.\n\tmsg, err := a.manager.NewCampaignMessage(camp, sub)\n\tif err != nil {\n\t\ta.log.Printf(\"error rendering message: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusNotFound, a.i18n.Ts(\"templates.errorRendering\", \"error\", err.Error()))\n\t}\n\n\treturn a.manager.PushCampaignMessage(msg)\n}\n\n// validateCampaignFields validates incoming campaign field values.\nfunc (a *App) validateCampaignFields(c campReq) (campReq, error) {\n\tif c.FromEmail == \"\" {\n\t\tc.FromEmail = a.cfg.FromEmail\n\t} else if !reFromAddress.Match([]byte(c.FromEmail)) {\n\t\tif _, err := a.importer.SanitizeEmail(c.FromEmail); err != nil {\n\t\t\treturn c, errors.New(a.i18n.T(\"campaigns.fieldInvalidFromEmail\"))\n\t\t}\n\t}\n\n\tif !strHasLen(c.Name, 1, stdInputMaxLen) {\n\t\treturn c, errors.New(a.i18n.T(\"campaigns.fieldInvalidName\"))\n\t}\n\n\t// Larger char limit for subject as it can contain {{ go templating }} logic.\n\tif !strHasLen(c.Subject, 1, 5000) {\n\t\treturn c, errors.New(a.i18n.T(\"campaigns.fieldInvalidSubject\"))\n\t}\n\n\t// If no content-type is specified, default to richtext.\n\tif c.ContentType != models.CampaignContentTypeRichtext &&\n\t\tc.ContentType != models.CampaignContentTypeHTML &&\n\t\tc.ContentType != models.CampaignContentTypePlain &&\n\t\tc.ContentType != models.CampaignContentTypeVisual &&\n\t\tc.ContentType != models.CampaignContentTypeMarkdown {\n\t\tc.ContentType = models.CampaignContentTypeRichtext\n\t}\n\n\tif c.ContentType != models.CampaignContentTypeVisual {\n\t\tc.BodySource.Valid = false\n\t}\n\n\t// If there's a \"send_at\" date, it should be in the future.\n\tif c.SendAt.Valid {\n\t\tif c.SendAt.Time.Before(time.Now()) {\n\t\t\treturn c, errors.New(a.i18n.T(\"campaigns.fieldInvalidSendAt\"))\n\t\t}\n\t}\n\n\tif len(c.ListIDs) == 0 {\n\t\treturn c, errors.New(a.i18n.T(\"campaigns.fieldInvalidListIDs\"))\n\t}\n\n\tif !a.manager.HasMessenger(c.Messenger) {\n\t\t// If it's a specific SMTP, but it's no longer available (removed/disabled), fall back to general email messenger.\n\t\tif strings.HasPrefix(c.Messenger, \"email-\") {\n\t\t\tc.Messenger = \"email\"\n\t\t} else {\n\t\t\treturn c, errors.New(a.i18n.Ts(\"campaigns.fieldInvalidMessenger\", \"name\", c.Messenger))\n\t\t}\n\t}\n\n\tcamp := models.Campaign{Body: c.Body, TemplateBody: tplTag}\n\tif err := c.CompileTemplate(a.manager.TemplateFuncs(&camp)); err != nil {\n\t\treturn c, errors.New(a.i18n.Ts(\"campaigns.fieldInvalidBody\", \"error\", err.Error()))\n\t}\n\n\tif len(c.Headers) == 0 {\n\t\tc.Headers = make([]map[string]string, 0)\n\t}\n\n\t// Validate and initialize attribs.\n\tif c.Attribs != nil {\n\t\tif _, err := json.Marshal(c.Attribs); err != nil {\n\t\t\treturn c, errors.New(a.i18n.T(\"subscribers.invalidJSON\"))\n\t\t}\n\t}\n\n\tif len(c.ArchiveMeta) == 0 {\n\t\tc.ArchiveMeta = json.RawMessage(\"{}\")\n\t}\n\n\tif c.ArchiveSlug.String != \"\" {\n\t\t// Format the slug to be alpha-numeric-dash.\n\t\ts := strings.ToLower(c.ArchiveSlug.String)\n\t\ts = strings.TrimSpace(reSlug.ReplaceAllString(s, \" \"))\n\t\ts = regexpSpaces.ReplaceAllString(s, \"-\")\n\n\t\tc.ArchiveSlug = null.NewString(s, true)\n\t} else {\n\t\t// If there's no slug set, set it to NULL in the DB.\n\t\tc.ArchiveSlug.Valid = false\n\t}\n\n\treturn c, nil\n}\n\n// makeOptinCampaignMessage makes a default opt-in campaign message body.\nfunc (a *App) makeOptinCampaignMessage(o campReq) (campReq, error) {\n\tif len(o.ListIDs) == 0 {\n\t\treturn o, echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"campaigns.fieldInvalidListIDs\"))\n\t}\n\n\t// Fetch double opt-in lists from the given list IDs from the DB.\n\tlists, err := a.core.GetListsByOptin(o.ListIDs, models.ListOptinDouble)\n\tif err != nil {\n\t\treturn o, err\n\t}\n\n\t// There are no double opt-in lists.\n\tif len(lists) == 0 {\n\t\treturn o, echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"campaigns.noOptinLists\"))\n\t}\n\n\t// Construct the opt-in URL with list IDs.\n\tlistIDs := url.Values{}\n\tfor _, l := range lists {\n\t\tlistIDs.Add(\"l\", l.UUID)\n\t}\n\t// optinURLFunc := template.URL(\"{{ OptinURL }}?\" + listIDs.Encode())\n\toptinURLAttr := template.HTMLAttr(fmt.Sprintf(`href=\"{{ OptinURL }}%s\"`, listIDs.Encode()))\n\n\t// Prepare sample opt-in message for the campaign.\n\tvar b bytes.Buffer\n\n\tif err := notifs.Tpls.ExecuteTemplate(&b, \"optin-campaign\", struct {\n\t\tLists []models.List\n\t\tOptinURLAttr template.HTMLAttr\n\t}{lists, optinURLAttr}); err != nil {\n\t\ta.log.Printf(\"error compiling 'optin-campaign' template: %v\", err)\n\t\treturn o, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"templates.errorCompiling\", \"error\", err.Error()))\n\t}\n\n\to.Body = b.String()\n\treturn o, nil\n}\n\n// checkCampaignPerm checks if the user has get or manage access to the given campaign.\n// Either the user has blanket get_all/manage_all permissions, or the campaign\n// belongs to lists that the user has access to.\nfunc (a *App) checkCampaignPerm(types auth.PermType, id int, c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\tperm := auth.PermCampaignsGet\n\tif types&auth.PermTypeGet != 0 {\n\t\t// It's a get request and there's a blanket get all permission.\n\t\tif user.HasPerm(auth.PermCampaignsGetAll) {\n\t\t\treturn nil\n\t\t}\n\t} else {\n\t\t// It's a manage request and there's a blanket manage_all permission.\n\t\tif user.HasPerm(auth.PermCampaignsManageAll) {\n\t\t\treturn nil\n\t\t}\n\n\t\tperm = auth.PermCampaignsManage\n\t}\n\n\t// There are no *_all campaign permissions. Instead, check if the user access\n\t// blanket get_all/manage_all list permissions. If yes, then the user can access\n\t// all campaigns. If there are no *_all permissions, then ensure that the\n\t// campaign belongs to the lists that the user has access to.\n\tif hasAllPerm, permittedListIDs := user.GetPermittedLists(auth.PermTypeGet | auth.PermTypeManage); !hasAllPerm {\n\t\tif ok, err := a.core.CampaignHasLists(id, permittedListIDs); err != nil {\n\t\t\treturn err\n\t\t} else if !ok {\n\t\t\treturn echo.NewHTTPError(http.StatusForbidden,\n\t\t\t\ta.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", perm))\n\t\t}\n\t}\n\n\treturn nil\n}\n\n// canEditCampaign returns true if a campaign is in a status where updating\n// its properties is allowed.\nfunc canEditCampaign(status string) bool {\n\treturn status == models.CampaignStatusDraft ||\n\t\tstatus == models.CampaignStatusPaused ||\n\t\tstatus == models.CampaignStatusScheduled\n}\n"
},
{
"path": "cmd/events.go",
"content": "package main\n\nimport (\n\t\"encoding/json\"\n\t\"fmt\"\n\t\"log\"\n\t\"time\"\n\n\t\"github.com/labstack/echo/v4\"\n)\n\n// EventStream serves an endpoint that never closes and pushes a\n// live event stream (text/event-stream) such as a error messages.\nfunc (a *App) EventStream(c echo.Context) error {\n\thdr := c.Response().Header()\n\thdr.Set(echo.HeaderContentType, \"text/event-stream\")\n\thdr.Set(echo.HeaderCacheControl, \"no-store\")\n\thdr.Set(echo.HeaderConnection, \"keep-alive\")\n\n\t// Subscribe to the event stream with a random ID.\n\tid := fmt.Sprintf(\"api:%v\", time.Now().UnixNano())\n\tsub, err := a.events.Subscribe(id)\n\tif err != nil {\n\t\tlog.Fatalf(\"error subscribing to events: %v\", err)\n\t}\n\n\tctx := c.Request().Context()\n\tfor {\n\t\tselect {\n\t\tcase e := <-sub:\n\t\t\tb, err := json.Marshal(e)\n\t\t\tif err != nil {\n\t\t\t\ta.log.Printf(\"error marshalling event: %v\", err)\n\t\t\t\tcontinue\n\t\t\t}\n\n\t\t\tc.Response().Write([]byte(fmt.Sprintf(\"retry: 3000\\ndata: %s\\n\\n\", b)))\n\t\t\tc.Response().Flush()\n\n\t\tcase <-ctx.Done():\n\t\t\t// On HTTP connection close, unsubscribe.\n\t\t\ta.events.Unsubscribe(id)\n\t\t\treturn nil\n\t\t}\n\t}\n\n}\n"
},
{
"path": "cmd/handlers.go",
"content": "package main\n\nimport (\n\t\"bytes\"\n\t\"net/http\"\n\t\"net/url\"\n\t\"path\"\n\t\"regexp\"\n\t\"strconv\"\n\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/labstack/echo/v4\"\n\t\"github.com/labstack/echo/v4/middleware\"\n)\n\nconst (\n\t// stdInputMaxLen is the maximum allowed length for a standard input field.\n\tstdInputMaxLen = 2000\n\n\t// URIs.\n\turiAdmin = \"/admin\"\n)\n\ntype okResp struct {\n\tData any `json:\"data\"`\n}\n\nvar (\n\treUUID = regexp.MustCompile(\"^[0-9a-fA-F]{8}-[0-9a-fA-F]{4}-[0-9a-fA-F]{4}-[0-9a-fA-F]{4}-[0-9a-fA-F]{12}$\")\n)\n\n// registerHandlers registers HTTP handlers.\nfunc initHTTPHandlers(e *echo.Echo, a *App) {\n\t// Default error handler.\n\te.HTTPErrorHandler = func(err error, c echo.Context) {\n\t\t// Generic, non-echo error. Log it.\n\t\tif _, ok := err.(*echo.HTTPError); !ok {\n\t\t\ta.log.Println(err.Error())\n\t\t}\n\t\te.DefaultHTTPErrorHandler(err, c)\n\t}\n\n\t// Configure CORS middleware if domains are configured.\n\tif len(a.cfg.Security.CorsOrigins) > 0 {\n\t\te.Use(middleware.CORSWithConfig(middleware.CORSConfig{\n\t\t\tAllowOrigins: a.cfg.Security.CorsOrigins,\n\t\t\tAllowHeaders: []string{echo.HeaderOrigin, echo.HeaderContentType, echo.HeaderAccept},\n\t\t}))\n\t}\n\n\t// =================================================================\n\t// Authenticated non /api handlers.\n\t{\n\t\t// Attach a middleware to the group that checks for auth.\n\t\tg := e.Group(\"\", a.auth.Middleware, func(next echo.HandlerFunc) echo.HandlerFunc {\n\t\t\treturn func(c echo.Context) error {\n\t\t\t\tu := c.Get(auth.UserHTTPCtxKey)\n\n\t\t\t\t// On no-auth, redirect to login page\n\t\t\t\tif _, ok := u.(*echo.HTTPError); ok {\n\t\t\t\t\tu, _ := url.Parse(a.urlCfg.LoginURL)\n\t\t\t\t\tq := url.Values{}\n\t\t\t\t\tq.Set(\"next\", c.Request().RequestURI)\n\t\t\t\t\tu.RawQuery = q.Encode()\n\t\t\t\t\treturn c.Redirect(http.StatusTemporaryRedirect, u.String())\n\t\t\t\t}\n\n\t\t\t\treturn next(c)\n\t\t\t}\n\t\t})\n\n\t\t// Authenticated endpoints.\n\t\tg.GET(path.Join(uriAdmin, \"\"), a.AdminPage)\n\t\tg.GET(path.Join(uriAdmin, \"/custom.css\"), serveCustomAppearance(\"admin.custom_css\"))\n\t\tg.GET(path.Join(uriAdmin, \"/custom.js\"), serveCustomAppearance(\"admin.custom_js\"))\n\t\tg.GET(path.Join(uriAdmin, \"/*\"), a.AdminPage)\n\t}\n\n\t// =================================================================\n\t// Authenticated /api/* handlers.\n\t{\n\t\tvar (\n\t\t\t// Permission check middleware.\n\t\t\tpm = a.auth.Perm\n\n\t\t\t// Attach a middleware to the group that checks for auth.\n\t\t\tg = e.Group(\"\", a.auth.Middleware, func(next echo.HandlerFunc) echo.HandlerFunc {\n\t\t\t\treturn func(c echo.Context) error {\n\t\t\t\t\tu := c.Get(auth.UserHTTPCtxKey)\n\n\t\t\t\t\t// On no-auth, respond with a JSON error.\n\t\t\t\t\tif err, ok := u.(*echo.HTTPError); ok {\n\t\t\t\t\t\treturn err\n\t\t\t\t\t}\n\n\t\t\t\t\treturn next(c)\n\t\t\t\t}\n\t\t\t})\n\t\t)\n\n\t\t// API endpoints.\n\t\tg.GET(\"/api/health\", a.HealthCheck)\n\t\tg.GET(\"/api/config\", a.GetServerConfig)\n\t\tg.GET(\"/api/lang/:lang\", a.GetI18nLang)\n\t\tg.GET(\"/api/dashboard/charts\", a.GetDashboardCharts)\n\t\tg.GET(\"/api/dashboard/counts\", a.GetDashboardCounts)\n\n\t\tg.GET(\"/api/settings\", pm(a.GetSettings, \"settings:get\"))\n\t\tg.PUT(\"/api/settings\", pm(a.UpdateSettings, \"settings:manage\"))\n\t\tg.PUT(\"/api/settings/:key\", pm(a.UpdateSettingsByKey, \"settings:manage\"))\n\t\tg.POST(\"/api/settings/smtp/test\", pm(a.TestSMTPSettings, \"settings:manage\"))\n\t\tg.POST(\"/api/admin/reload\", pm(a.ReloadApp, \"settings:manage\"))\n\t\tg.GET(\"/api/logs\", pm(a.GetLogs, \"settings:get\"))\n\t\tg.GET(\"/api/events\", pm(a.EventStream, \"settings:get\"))\n\t\tg.GET(\"/api/about\", a.GetAboutInfo)\n\n\t\tg.GET(\"/api/subscribers\", pm(a.QuerySubscribers, \"subscribers:get_all\", \"subscribers:get\"))\n\t\tg.GET(\"/api/subscribers/:id\", pm(hasID(a.GetSubscriber), \"subscribers:get_all\", \"subscribers:get\"))\n\t\tg.GET(\"/api/subscribers/:id/activity\", pm(hasID(a.GetSubscriberActivity), \"subscribers:get_all\", \"subscribers:get\"))\n\t\tg.GET(\"/api/subscribers/:id/export\", pm(hasID(a.ExportSubscriberData), \"subscribers:get_all\", \"subscribers:get\"))\n\t\tg.GET(\"/api/subscribers/:id/bounces\", pm(hasID(a.GetSubscriberBounces), \"bounces:get\"))\n\t\tg.DELETE(\"/api/subscribers/:id/bounces\", pm(hasID(a.DeleteSubscriberBounces), \"bounces:manage\"))\n\t\tg.POST(\"/api/subscribers\", pm(a.CreateSubscriber, \"subscribers:manage\"))\n\t\tg.PUT(\"/api/subscribers/:id\", pm(hasID(a.UpdateSubscriber), \"subscribers:manage\"))\n\t\tg.POST(\"/api/subscribers/:id/optin\", pm(hasID(a.SubscriberSendOptin), \"subscribers:manage\"))\n\t\tg.PUT(\"/api/subscribers/blocklist\", pm(a.BlocklistSubscribers, \"subscribers:manage\"))\n\t\tg.PUT(\"/api/subscribers/:id/blocklist\", pm(hasID(a.BlocklistSubscriber), \"subscribers:manage\"))\n\t\tg.PUT(\"/api/subscribers/lists/:id\", pm(a.ManageSubscriberLists, \"subscribers:manage\"))\n\t\tg.PUT(\"/api/subscribers/lists\", pm(a.ManageSubscriberLists, \"subscribers:manage\"))\n\t\tg.DELETE(\"/api/subscribers/:id\", pm(hasID(a.DeleteSubscriber), \"subscribers:manage\"))\n\t\tg.DELETE(\"/api/subscribers\", pm(a.DeleteSubscribers, \"subscribers:manage\"))\n\n\t\tg.GET(\"/api/bounces\", pm(a.GetBounces, \"bounces:get\"))\n\t\tg.PUT(\"/api/bounces/blocklist\", pm(a.BlocklistBouncedSubscribers, \"bounces:manage\"))\n\t\tg.GET(\"/api/bounces/:id\", pm(hasID(a.GetBounce), \"bounces:get\"))\n\t\tg.DELETE(\"/api/bounces\", pm(a.DeleteBounces, \"bounces:manage\"))\n\t\tg.DELETE(\"/api/bounces/:id\", pm(hasID(a.DeleteBounce), \"bounces:manage\"))\n\n\t\t// Subscriber operations based on arbitrary SQL queries.\n\t\t// These aren't very REST-like.\n\t\tg.POST(\"/api/subscribers/query/delete\", pm(a.DeleteSubscribersByQuery, \"subscribers:manage\"))\n\t\tg.PUT(\"/api/subscribers/query/blocklist\", pm(a.BlocklistSubscribersByQuery, \"subscribers:manage\"))\n\t\tg.PUT(\"/api/subscribers/query/lists\", pm(a.ManageSubscriberListsByQuery, \"subscribers:manage\"))\n\t\tg.GET(\"/api/subscribers/export\",\n\t\t\tpm(middleware.GzipWithConfig(middleware.GzipConfig{Level: 9})(a.ExportSubscribers), \"subscribers:get_all\", \"subscribers:get\"))\n\n\t\tg.GET(\"/api/import/subscribers\", pm(a.GetImportSubscribers, \"subscribers:import\"))\n\t\tg.GET(\"/api/import/subscribers/logs\", pm(a.GetImportSubscriberStats, \"subscribers:import\"))\n\t\tg.POST(\"/api/import/subscribers\", pm(a.ImportSubscribers, \"subscribers:import\"))\n\t\tg.DELETE(\"/api/import/subscribers\", pm(a.StopImportSubscribers, \"subscribers:import\"))\n\n\t\t// Individual list permissions are applied directly within handleGetLists.\n\t\tg.GET(\"/api/lists\", a.GetLists)\n\t\tg.GET(\"/api/lists/:id\", hasID(a.GetList))\n\t\tg.POST(\"/api/lists\", pm(a.CreateList, \"lists:manage_all\"))\n\t\tg.PUT(\"/api/lists/:id\", hasID(a.UpdateList))\n\t\tg.DELETE(\"/api/lists\", a.DeleteLists)\n\t\tg.DELETE(\"/api/lists/:id\", hasID(a.DeleteList))\n\n\t\tg.GET(\"/api/campaigns\", pm(a.GetCampaigns, \"campaigns:get_all\", \"campaigns:get\"))\n\t\tg.GET(\"/api/campaigns/running/stats\", pm(a.GetRunningCampaignStats, \"campaigns:get_all\", \"campaigns:get\"))\n\t\tg.GET(\"/api/campaigns/:id\", pm(hasID(a.GetCampaign), \"campaigns:get_all\", \"campaigns:get\"))\n\t\tg.GET(\"/api/campaigns/analytics/:type\", pm(a.GetCampaignViewAnalytics, \"campaigns:get_analytics\"))\n\t\tg.GET(\"/api/campaigns/:id/preview\", pm(hasID(a.PreviewCampaign), \"campaigns:get_all\", \"campaigns:get\"))\n\t\tg.POST(\"/api/campaigns/:id/preview/archive\", pm(hasID(a.PreviewCampaignArchive), \"campaigns:get_all\", \"campaigns:get\"))\n\t\tg.POST(\"/api/campaigns/:id/preview\", pm(hasID(a.PreviewCampaign), \"campaigns:get_all\", \"campaigns:get\"))\n\t\tg.POST(\"/api/campaigns/:id/content\", pm(hasID(a.CampaignContent), \"campaigns:manage_all\", \"campaigns:manage\"))\n\t\tg.POST(\"/api/campaigns/:id/text\", pm(hasID(a.PreviewCampaign), \"campaigns:get\"))\n\t\tg.POST(\"/api/campaigns/:id/test\", pm(hasID(a.TestCampaign), \"campaigns:manage_all\", \"campaigns:manage\"))\n\t\tg.POST(\"/api/campaigns\", pm(a.CreateCampaign, \"campaigns:manage_all\", \"campaigns:manage\"))\n\t\tg.PUT(\"/api/campaigns/:id\", pm(hasID(a.UpdateCampaign), \"campaigns:manage_all\", \"campaigns:manage\"))\n\t\tg.PUT(\"/api/campaigns/:id/status\", pm(hasID(a.UpdateCampaignStatus), \"campaigns:manage_all\", \"campaigns:manage\"))\n\t\tg.PUT(\"/api/campaigns/:id/archive\", pm(hasID(a.UpdateCampaignArchive), \"campaigns:manage_all\", \"campaigns:manage\"))\n\t\tg.DELETE(\"/api/campaigns\", pm(a.DeleteCampaigns, \"campaigns:manage\", \"campaigns:manage_all\"))\n\t\tg.DELETE(\"/api/campaigns/:id\", pm(hasID(a.DeleteCampaign), \"campaigns:manage_all\", \"campaigns:manage\"))\n\n\t\tg.GET(\"/api/media\", pm(a.GetAllMedia, \"media:get\"))\n\t\tg.GET(\"/api/media/:id\", pm(hasID(a.GetMedia), \"media:get\"))\n\t\tg.POST(\"/api/media\", pm(a.UploadMedia, \"media:manage\"))\n\t\tg.DELETE(\"/api/media/:id\", pm(hasID(a.DeleteMedia), \"media:manage\"))\n\n\t\tg.GET(\"/api/templates\", pm(a.GetTemplates, \"templates:get\"))\n\t\tg.GET(\"/api/templates/:id\", pm(hasID(a.GetTemplate), \"templates:get\"))\n\t\tg.GET(\"/api/templates/:id/preview\", pm(hasID(a.PreviewTemplate), \"templates:get\"))\n\t\tg.POST(\"/api/templates/preview\", pm(a.PreviewTemplateBody, \"templates:get\"))\n\t\tg.POST(\"/api/templates\", pm(a.CreateTemplate, \"templates:manage\"))\n\t\tg.PUT(\"/api/templates/:id\", pm(hasID(a.UpdateTemplate), \"templates:manage\"))\n\t\tg.PUT(\"/api/templates/:id/default\", pm(hasID(a.TemplateSetDefault), \"templates:manage\"))\n\t\tg.DELETE(\"/api/templates/:id\", pm(hasID(a.DeleteTemplate), \"templates:manage\"))\n\n\t\tg.DELETE(\"/api/maintenance/subscribers/:type\", pm(a.GCSubscribers, \"settings:maintain\"))\n\t\tg.DELETE(\"/api/maintenance/analytics/:type\", pm(a.GCCampaignAnalytics, \"settings:maintain\"))\n\t\tg.DELETE(\"/api/maintenance/subscriptions/unconfirmed\", pm(a.GCSubscriptions, \"settings:maintain\"))\n\n\t\tg.POST(\"/api/tx\", pm(a.SendTxMessage, \"tx:send\"))\n\n\t\tg.GET(\"/api/profile\", a.GetUserProfile)\n\t\tg.PUT(\"/api/profile\", a.UpdateUserProfile)\n\t\tg.GET(\"/api/users\", pm(a.GetUsers, \"users:get\"))\n\t\tg.GET(\"/api/users/:id\", pm(hasID(a.GetUser), \"users:get\"))\n\t\tg.POST(\"/api/users\", pm(a.CreateUser, \"users:manage\"))\n\t\tg.PUT(\"/api/users/:id\", pm(hasID(a.UpdateUser), \"users:manage\"))\n\t\tg.DELETE(\"/api/users\", pm(a.DeleteUsers, \"users:manage\"))\n\t\tg.DELETE(\"/api/users/:id\", pm(hasID(a.DeleteUser), \"users:manage\"))\n\t\tg.POST(\"/api/logout\", a.Logout)\n\n\t\t// TOTP 2FA endpoints\n\t\tg.GET(\"/api/users/:id/twofa/totp\", hasID(a.GenerateTOTPQR))\n\t\tg.PUT(\"/api/users/:id/twofa\", hasID(a.EnableTOTP))\n\t\tg.DELETE(\"/api/users/:id/twofa\", hasID(a.DisableTOTP))\n\n\t\tg.GET(\"/api/roles/users\", pm(a.GetUserRoles, \"roles:get\"))\n\t\tg.GET(\"/api/roles/lists\", pm(a.GeListRoles, \"roles:get\"))\n\t\tg.POST(\"/api/roles/users\", pm(a.CreateUserRole, \"roles:manage\"))\n\t\tg.POST(\"/api/roles/lists\", pm(a.CreateListRole, \"roles:manage\"))\n\t\tg.PUT(\"/api/roles/users/:id\", pm(hasID(a.UpdateUserRole), \"roles:manage\"))\n\t\tg.PUT(\"/api/roles/lists/:id\", pm(hasID(a.UpdateListRole), \"roles:manage\"))\n\t\tg.DELETE(\"/api/roles/:id\", pm(hasID(a.DeleteRole), \"roles:manage\"))\n\n\t\tif a.cfg.BounceWebhooksEnabled {\n\t\t\t// Private authenticated bounce endpoint.\n\t\t\tg.POST(\"/webhooks/bounce\", pm(a.BounceWebhook, \"webhooks:post_bounce\"))\n\t\t}\n\t}\n\n\t// =================================================================\n\t// Public API endpoints.\n\t{\n\t\t// Public unauthenticated endpoints.\n\t\tg := e.Group(\"\")\n\n\t\tif a.cfg.BounceWebhooksEnabled {\n\t\t\t// Public bounce endpoints for webservices like SES.\n\t\t\tg.POST(\"/webhooks/service/:service\", a.BounceWebhook)\n\t\t}\n\n\t\t// Landing page.\n\t\tg.GET(\"/\", func(c echo.Context) error {\n\t\t\treturn c.Render(http.StatusOK, \"home\", publicTpl{Title: \"listmonk\"})\n\t\t})\n\n\t\t// Public admin endpoints (login page, OIDC endpoints, password reset).\n\t\tg.GET(path.Join(uriAdmin, \"/login\"), a.LoginPage)\n\t\tg.POST(path.Join(uriAdmin, \"/login\"), a.LoginPage)\n\t\tg.GET(path.Join(uriAdmin, \"/login/twofa\"), a.TwofaPage)\n\t\tg.POST(path.Join(uriAdmin, \"/login/twofa\"), a.TwofaPage)\n\t\tg.GET(path.Join(uriAdmin, \"/forgot\"), a.ForgotPage)\n\t\tg.POST(path.Join(uriAdmin, \"/forgot\"), a.ForgotPage)\n\t\tg.GET(path.Join(uriAdmin, \"/reset\"), a.ResetPage)\n\t\tg.POST(path.Join(uriAdmin, \"/reset\"), a.ResetPage)\n\n\t\tif a.cfg.Security.OIDC.Enabled {\n\t\t\tg.POST(\"/auth/oidc\", a.OIDCLogin)\n\t\t\tg.GET(\"/auth/oidc\", a.OIDCFinish)\n\t\t}\n\n\t\t// Public APIs.\n\t\tg.GET(\"/api/public/lists\", a.GetPublicLists)\n\t\tg.POST(\"/api/public/subscription\", a.PublicSubscription)\n\t\tg.GET(\"/api/public/captcha/altcha\", a.AltchaChallenge)\n\t\tif a.cfg.EnablePublicArchive {\n\t\t\tg.GET(\"/api/public/archive\", a.GetCampaignArchives)\n\t\t}\n\n\t\t// /public/static/* file server is registered in initHTTPServer().\n\t\t// Public subscriber facing views.\n\t\tg.GET(\"/subscription/form\", a.SubscriptionFormPage)\n\t\tg.POST(\"/subscription/form\", a.SubscriptionForm)\n\t\tg.GET(\"/subscription/:campUUID/:subUUID\", noIndex(a.hasUUID(a.hasSub(a.SubscriptionPage), \"campUUID\", \"subUUID\")))\n\t\tg.POST(\"/subscription/:campUUID/:subUUID\", a.hasUUID(a.hasSub(a.SubscriptionPrefs), \"campUUID\", \"subUUID\"))\n\t\tg.GET(\"/subscription/optin/:subUUID\", noIndex(a.hasUUID(a.hasSub(a.OptinPage), \"subUUID\")))\n\t\tg.POST(\"/subscription/optin/:subUUID\", a.hasUUID(a.hasSub(a.OptinPage), \"subUUID\"))\n\t\tg.POST(\"/subscription/export/:subUUID\", a.hasUUID(a.hasSub(a.SelfExportSubscriberData), \"subUUID\"))\n\t\tg.POST(\"/subscription/wipe/:subUUID\", a.hasUUID(a.hasSub(a.WipeSubscriberData), \"subUUID\"))\n\t\tg.GET(\"/link/:linkUUID/:campUUID/:subUUID\", noIndex(a.hasUUID(a.LinkRedirect, \"linkUUID\", \"campUUID\", \"subUUID\")))\n\t\tg.GET(\"/campaign/:campUUID/:subUUID\", noIndex(a.hasUUID(a.ViewCampaignMessage, \"campUUID\", \"subUUID\")))\n\t\tg.GET(\"/campaign/:campUUID/:subUUID/px.png\", noIndex(a.hasUUID(a.RegisterCampaignView, \"campUUID\", \"subUUID\")))\n\n\t\tif a.cfg.EnablePublicArchive {\n\t\t\tg.GET(\"/archive\", a.CampaignArchivesPage)\n\t\t\tg.GET(\"/archive.xml\", a.GetCampaignArchivesFeed)\n\t\t\tg.GET(\"/archive/:id\", a.CampaignArchivePage)\n\t\t\tg.GET(\"/archive/latest\", a.CampaignArchivePageLatest)\n\t\t}\n\n\t\tg.GET(\"/public/custom.css\", serveCustomAppearance(\"public.custom_css\"))\n\t\tg.GET(\"/public/custom.js\", serveCustomAppearance(\"public.custom_js\"))\n\n\t\t// Public health API endpoint.\n\t\tg.GET(\"/health\", a.HealthCheck)\n\n\t\t// 404 pages.\n\t\tg.RouteNotFound(\"/*\", func(c echo.Context) error {\n\t\t\treturn c.Render(http.StatusNotFound, tplMessage,\n\t\t\t\tmakeMsgTpl(\"404 - \"+a.i18n.T(\"public.notFoundTitle\"), \"\", \"\"))\n\t\t})\n\t\tg.RouteNotFound(\"/api/*\", func(c echo.Context) error {\n\t\t\treturn echo.NewHTTPError(http.StatusNotFound, \"404 unknown endpoint\")\n\t\t})\n\t\tg.RouteNotFound(\"/admin/*\", func(c echo.Context) error {\n\t\t\treturn echo.NewHTTPError(http.StatusNotFound, \"404 page not found\")\n\t\t})\n\t}\n}\n\n// AdminPage is the root handler that renders the Javascript admin frontend.\nfunc (a *App) AdminPage(c echo.Context) error {\n\tb, err := a.fs.Read(path.Join(uriAdmin, \"/index.html\"))\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, err.Error())\n\t}\n\n\tb = bytes.ReplaceAll(b, []byte(\"asset_version\"), []byte(a.cfg.AssetVersion))\n\n\treturn c.HTMLBlob(http.StatusOK, b)\n}\n\n// HealthCheck is a healthcheck endpoint that returns a 200 response.\nfunc (a *App) HealthCheck(c echo.Context) error {\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// serveCustomAppearance serves the given custom CSS/JS appearance blob\n// meant for customizing public and admin pages from the admin settings UI.\nfunc serveCustomAppearance(name string) echo.HandlerFunc {\n\treturn func(c echo.Context) error {\n\t\tvar (\n\t\t\tapp = c.Get(\"app\").(*App)\n\n\t\t\tout []byte\n\t\t\thdr string\n\t\t)\n\n\t\tswitch name {\n\t\tcase \"admin.custom_css\":\n\t\t\tout = app.cfg.Appearance.AdminCSS\n\t\t\thdr = \"text/css; charset=utf-8\"\n\n\t\tcase \"admin.custom_js\":\n\t\t\tout = app.cfg.Appearance.AdminJS\n\t\t\thdr = \"application/javascript; charset=utf-8\"\n\n\t\tcase \"public.custom_css\":\n\t\t\tout = app.cfg.Appearance.PublicCSS\n\t\t\thdr = \"text/css; charset=utf-8\"\n\n\t\tcase \"public.custom_js\":\n\t\t\tout = app.cfg.Appearance.PublicJS\n\t\t\thdr = \"application/javascript; charset=utf-8\"\n\t\t}\n\n\t\treturn c.Blob(http.StatusOK, hdr, out)\n\t}\n}\n\n// hasUUID middleware validates the UUID string format for a given set of params.\nfunc (a *App) hasUUID(next echo.HandlerFunc, params ...string) echo.HandlerFunc {\n\treturn func(c echo.Context) error {\n\t\tfor _, p := range params {\n\t\t\tif !reUUID.MatchString(c.Param(p)) {\n\t\t\t\treturn c.Render(http.StatusBadRequest, tplMessage, makeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\",\n\t\t\t\t\ta.i18n.T(\"globals.messages.invalidUUID\")))\n\t\t\t}\n\t\t}\n\t\treturn next(c)\n\t}\n}\n\n// hasID middleware validates the :id param in the URL and sets its int value in the context.\nfunc hasID(next echo.HandlerFunc) echo.HandlerFunc {\n\treturn func(c echo.Context) error {\n\t\tid, _ := strconv.Atoi(c.Param(\"id\"))\n\t\tif id < 1 {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, \"invalid ID\")\n\t\t}\n\n\t\tc.Set(\"id\", id)\n\t\treturn next(c)\n\t}\n}\n\n// hasSub middleware checks if a subscriber exists given the UUID\n// param in a request.\nfunc (a *App) hasSub(next echo.HandlerFunc) echo.HandlerFunc {\n\treturn func(c echo.Context) error {\n\t\tsubUUID := c.Param(\"subUUID\")\n\n\t\tif _, err := a.core.GetSubscriber(0, subUUID, \"\"); err != nil {\n\t\t\tif er, ok := err.(*echo.HTTPError); ok && er.Code == http.StatusBadRequest {\n\t\t\t\treturn c.Render(http.StatusNotFound, tplMessage,\n\t\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.notFoundTitle\"), \"\", er.Message.(string)))\n\t\t\t}\n\n\t\t\ta.log.Printf(\"error checking subscriber existence: %v\", err)\n\t\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"public.errorProcessingRequest\")))\n\t\t}\n\n\t\treturn next(c)\n\t}\n}\n\n// noIndex adds the HTTP header requesting robots to not crawl the page.\nfunc noIndex(next echo.HandlerFunc) echo.HandlerFunc {\n\treturn func(c echo.Context) error {\n\t\tc.Response().Header().Set(\"X-Robots-Tag\", \"noindex\")\n\t\treturn next(c)\n\t}\n}\n\n// getID returns the :id param from the URL parsed and stored as an int by the hasID middleware.\nfunc getID(c echo.Context) int {\n\treturn c.Get(\"id\").(int)\n}\n"
},
{
"path": "cmd/i18n.go",
"content": "package main\n\nimport (\n\t\"encoding/json\"\n\t\"fmt\"\n\t\"net/http\"\n\t\"regexp\"\n\t\"sort\"\n\n\t\"github.com/knadh/listmonk/internal/i18n\"\n\t\"github.com/knadh/stuffbin\"\n\t\"github.com/labstack/echo/v4\"\n)\n\ntype i18nLang struct {\n\tCode string `json:\"code\"`\n\tName string `json:\"name\"`\n}\n\ntype i18nLangRaw struct {\n\tCode string `json:\"_.code\"`\n\tName string `json:\"_.name\"`\n}\n\nvar reLangCode = regexp.MustCompile(`[^a-zA-Z_0-9\\\\-]`)\n\n// GetI18nLang returns the JSON language pack given the language code.\nfunc (a *App) GetI18nLang(c echo.Context) error {\n\tlang := c.Param(\"lang\")\n\tif len(lang) > 6 || reLangCode.MatchString(lang) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, \"Invalid language code.\")\n\t}\n\n\ti, ok, err := getI18nLang(lang, a.fs)\n\tif err != nil && !ok {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, \"Unknown language.\")\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{json.RawMessage(i.JSON())})\n}\n\n// getI18nLangList returns the list of available i18n languages.\nfunc getI18nLangList(fs stuffbin.FileSystem) ([]i18nLang, error) {\n\tlist, err := fs.Glob(\"/i18n/*.json\")\n\tif err != nil {\n\t\treturn nil, err\n\t}\n\n\t// Read language JSON files from the fs.\n\tvar out []i18nLang\n\tfor _, l := range list {\n\t\tb, err := fs.Get(l)\n\t\tif err != nil {\n\t\t\treturn out, fmt.Errorf(\"error reading lang file: %s: %v\", l, err)\n\t\t}\n\n\t\tvar r i18nLangRaw\n\t\tif err := json.Unmarshal(b.ReadBytes(), &r); err != nil {\n\t\t\treturn out, fmt.Errorf(\"error parsing lang file: %s: %v\", l, err)\n\t\t}\n\n\t\tout = append(out, i18nLang(r))\n\t}\n\n\t// Sort by language code.\n\tsort.SliceStable(out, func(i, j int) bool {\n\t\treturn out[i].Code < out[j].Code\n\t})\n\n\treturn out, nil\n}\n\n// The bool indicates whether the specified language could be loaded. If it couldn't\n// be, the app shouldn't halt but throw a warning.\nfunc getI18nLang(lang string, fs stuffbin.FileSystem) (*i18n.I18n, bool, error) {\n\tconst def = \"en\"\n\n\tb, err := fs.Read(fmt.Sprintf(\"/i18n/%s.json\", def))\n\tif err != nil {\n\t\treturn nil, false, fmt.Errorf(\"error reading default i18n language file: %s: %v\", def, err)\n\t}\n\n\t// Initialize with the default language.\n\ti, err := i18n.New(b)\n\tif err != nil {\n\t\treturn nil, false, fmt.Errorf(\"error unmarshalling i18n language: %s: %v\", lang, err)\n\t}\n\n\t// Load the selected language on top of it.\n\tb, err = fs.Read(fmt.Sprintf(\"/i18n/%s.json\", lang))\n\tif err != nil {\n\t\treturn i, true, fmt.Errorf(\"error reading i18n language file: %s: %v\", lang, err)\n\t}\n\tif err := i.Load(b); err != nil {\n\t\treturn i, true, fmt.Errorf(\"error loading i18n language file: %s: %v\", lang, err)\n\t}\n\n\treturn i, true, nil\n}\n"
},
{
"path": "cmd/import.go",
"content": "package main\n\nimport (\n\t\"encoding/json\"\n\t\"io\"\n\t\"net/http\"\n\t\"os\"\n\t\"strings\"\n\n\t\"github.com/knadh/listmonk/internal/subimporter\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n)\n\n// ImportSubscribers handles the uploading and bulk importing of\n// a ZIP file of one or more CSV files.\nfunc (a *App) ImportSubscribers(c echo.Context) error {\n\t// Is an import already running?\n\tif a.importer.GetStats().Status == subimporter.StatusImporting {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"import.alreadyRunning\"))\n\t}\n\n\t// Unmarshal the JSON params.\n\tvar opt subimporter.SessionOpt\n\tif err := json.Unmarshal([]byte(c.FormValue(\"params\")), &opt); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"import.invalidParams\", \"error\", err.Error()))\n\t}\n\n\t// Validate mode.\n\tif opt.Mode != subimporter.ModeSubscribe && opt.Mode != subimporter.ModeBlocklist {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"import.invalidMode\"))\n\t}\n\n\t// If no status is specified, pick a default one.\n\tif opt.SubStatus == \"\" {\n\t\tswitch opt.Mode {\n\t\tcase subimporter.ModeSubscribe:\n\t\t\topt.SubStatus = models.SubscriptionStatusUnconfirmed\n\t\tcase subimporter.ModeBlocklist:\n\t\t\topt.SubStatus = models.SubscriptionStatusUnsubscribed\n\t\t}\n\t}\n\n\tif opt.SubStatus != models.SubscriptionStatusUnconfirmed &&\n\t\topt.SubStatus != models.SubscriptionStatusConfirmed &&\n\t\topt.SubStatus != models.SubscriptionStatusUnsubscribed {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"import.invalidSubStatus\"))\n\t}\n\n\tif len(opt.Delim) != 1 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"import.invalidDelim\"))\n\t}\n\n\t// Open the HTTP file.\n\tfile, err := c.FormFile(\"file\")\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"import.invalidFile\", \"error\", err.Error()))\n\t}\n\n\tsrc, err := file.Open()\n\tif err != nil {\n\t\treturn err\n\t}\n\tdefer src.Close()\n\n\t// Copy it to a temp location.\n\tout, err := os.CreateTemp(\"\", \"listmonk\")\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\ta.i18n.Ts(\"import.errorCopyingFile\", \"error\", err.Error()))\n\t}\n\tdefer out.Close()\n\n\tif _, err = io.Copy(out, src); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\ta.i18n.Ts(\"import.errorCopyingFile\", \"error\", err.Error()))\n\t}\n\n\t// Start the importer session.\n\topt.Filename = file.Filename\n\tsess, err := a.importer.NewSession(opt)\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\ta.i18n.Ts(\"import.errorStarting\", \"error\", err.Error()))\n\t}\n\tgo sess.Start()\n\n\tif strings.HasSuffix(strings.ToLower(file.Filename), \".csv\") {\n\t\tgo sess.LoadCSV(out.Name(), rune(opt.Delim[0]))\n\t} else {\n\t\t// Only 1 CSV from the ZIP is considered. If multiple files have\n\t\t// to be processed, counting the net number of lines (to track progress),\n\t\t// keeping the global import state (failed / successful) etc. across\n\t\t// multiple files becomes complex. Instead, it's just easier for the\n\t\t// end user to concat multiple CSVs (if there are multiple in the first)\n\t\t// place and upload as one in the first place.\n\t\tdir, files, err := sess.ExtractZIP(out.Name(), 1)\n\t\tif err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\t\ta.i18n.Ts(\"import.errorProcessingZIP\", \"error\", err.Error()))\n\t\t}\n\n\t\tgo sess.LoadCSV(dir+\"/\"+files[0], rune(opt.Delim[0]))\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{a.importer.GetStats()})\n}\n\n// GetImportSubscribers returns import statistics.\nfunc (a *App) GetImportSubscribers(c echo.Context) error {\n\ts := a.importer.GetStats()\n\treturn c.JSON(http.StatusOK, okResp{s})\n}\n\n// GetImportSubscriberStats returns import statistics.\nfunc (a *App) GetImportSubscriberStats(c echo.Context) error {\n\treturn c.JSON(http.StatusOK, okResp{string(a.importer.GetLogs())})\n}\n\n// StopImportSubscribers sends a stop signal to the importer.\n// If there's an ongoing import, it'll be stopped, and if an import\n// is finished, it's state is cleared.\nfunc (a *App) StopImportSubscribers(c echo.Context) error {\n\ta.importer.Stop()\n\treturn c.JSON(http.StatusOK, okResp{a.importer.GetStats()})\n}\n"
},
{
"path": "cmd/init.go",
"content": "package main\n\nimport (\n\t\"bytes\"\n\t\"crypto/md5\"\n\t\"database/sql\"\n\t\"encoding/json\"\n\t\"errors\"\n\t\"fmt\"\n\t\"html/template\"\n\t\"io\"\n\t\"log\"\n\t\"log/slog\"\n\t\"maps\"\n\t\"net/http\"\n\t\"os\"\n\t\"path\"\n\t\"path/filepath\"\n\t\"runtime\"\n\t\"strings\"\n\t\"syscall\"\n\t\"time\"\n\n\t\"github.com/Masterminds/sprig/v3\"\n\t\"github.com/gdgvda/cron\"\n\t\"github.com/jmoiron/sqlx\"\n\t\"github.com/jmoiron/sqlx/types\"\n\t\"github.com/knadh/goyesql/v2\"\n\tgoyesqlx \"github.com/knadh/goyesql/v2/sqlx\"\n\tkoanfmaps \"github.com/knadh/koanf/maps\"\n\t\"github.com/knadh/koanf/parsers/toml\"\n\t\"github.com/knadh/koanf/providers/confmap\"\n\t\"github.com/knadh/koanf/providers/file\"\n\t\"github.com/knadh/koanf/providers/posflag\"\n\t\"github.com/knadh/koanf/v2\"\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/internal/bounce\"\n\t\"github.com/knadh/listmonk/internal/bounce/mailbox\"\n\t\"github.com/knadh/listmonk/internal/captcha\"\n\t\"github.com/knadh/listmonk/internal/core\"\n\t\"github.com/knadh/listmonk/internal/i18n\"\n\t\"github.com/knadh/listmonk/internal/manager\"\n\t\"github.com/knadh/listmonk/internal/media\"\n\t\"github.com/knadh/listmonk/internal/media/providers/filesystem\"\n\t\"github.com/knadh/listmonk/internal/media/providers/s3\"\n\t\"github.com/knadh/listmonk/internal/messenger/email\"\n\t\"github.com/knadh/listmonk/internal/messenger/postback\"\n\t\"github.com/knadh/listmonk/internal/notifs\"\n\t\"github.com/knadh/listmonk/internal/subimporter\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/knadh/stuffbin\"\n\t\"github.com/labstack/echo/v4\"\n\t\"github.com/lib/pq\"\n\tflag \"github.com/spf13/pflag\"\n\t\"gopkg.in/volatiletech/null.v6\"\n)\n\nconst (\n\t// Path to the SQL queries directory in the embedded FS.\n\tqueryFilePath = \"/queries\"\n\n\temailMsgr = \"email\"\n)\n\n// UrlConfig contains various URL constants used in the app.\ntype UrlConfig struct {\n\tRootURL string `koanf:\"root_url\"`\n\tLogoURL string `koanf:\"logo_url\"`\n\tFaviconURL string `koanf:\"favicon_url\"`\n\tLoginURL string `koanf:\"login_url\"`\n\tUnsubURL string\n\tLinkTrackURL string\n\tViewTrackURL string\n\tOptinURL string\n\tMessageURL string\n\tArchiveURL string\n}\n\n// Config contains static, constant config values required by arbitrary handlers and functions.\ntype Config struct {\n\tSiteName string `koanf:\"site_name\"`\n\tFromEmail string `koanf:\"from_email\"`\n\tNotifyEmails []string `koanf:\"notify_emails\"`\n\tEnablePublicSubPage bool `koanf:\"enable_public_subscription_page\"`\n\tEnablePublicArchive bool `koanf:\"enable_public_archive\"`\n\tEnablePublicArchiveRSSContent bool `koanf:\"enable_public_archive_rss_content\"`\n\tLang string `koanf:\"lang\"`\n\tDBBatchSize int `koanf:\"batch_size\"`\n\tPrivacy struct {\n\t\tIndividualTracking bool `koanf:\"individual_tracking\"`\n\t\tDisableTracking bool `koanf:\"disable_tracking\"`\n\t\tAllowPreferences bool `koanf:\"allow_preferences\"`\n\t\tAllowBlocklist bool `koanf:\"allow_blocklist\"`\n\t\tAllowExport bool `koanf:\"allow_export\"`\n\t\tAllowWipe bool `koanf:\"allow_wipe\"`\n\t\tRecordOptinIP bool `koanf:\"record_optin_ip\"`\n\t\tUnsubHeader bool `koanf:\"unsubscribe_header\"`\n\t\tExportable map[string]bool `koanf:\"-\"`\n\t\tDomainBlocklist []string `koanf:\"-\"`\n\t\tDomainAllowlist []string `koanf:\"-\"`\n\t} `koanf:\"privacy\"`\n\tSecurity struct {\n\t\tOIDC struct {\n\t\t\tEnabled bool `koanf:\"enabled\"`\n\t\t\tProviderURL string `koanf:\"provider_url\"`\n\t\t\tProviderName string `koanf:\"provider_name\"`\n\t\t\tClientID string `koanf:\"client_id\"`\n\t\t\tClientSecret string `koanf:\"client_secret\"`\n\t\t\tAutoCreateUsers bool `koanf:\"auto_create_users\"`\n\t\t\tDefaultUserRoleID int `koanf:\"default_user_role_id\"`\n\t\t\tDefaultListRoleID int `koanf:\"default_list_role_id\"`\n\t\t} `koanf:\"oidc\"`\n\n\t\tCaptcha struct {\n\t\t\tAltcha struct {\n\t\t\t\tEnabled bool `koanf:\"enabled\"`\n\t\t\t\tComplexity int `koanf:\"complexity\"`\n\t\t\t} `koanf:\"altcha\"`\n\t\t\tHCaptcha struct {\n\t\t\t\tEnabled bool `koanf:\"enabled\"`\n\t\t\t\tKey string `koanf:\"key\"`\n\t\t\t\tSecret string `koanf:\"secret\"`\n\t\t\t} `koanf:\"hcaptcha\"`\n\t\t} `koanf:\"captcha\"`\n\n\t\tCorsOrigins []string `koanf:\"cors_origins\"`\n\t} `koanf:\"security\"`\n\n\tAppearance struct {\n\t\tAdminCSS []byte `koanf:\"admin.custom_css\"`\n\t\tAdminJS []byte `koanf:\"admin.custom_js\"`\n\t\tPublicCSS []byte `koanf:\"public.custom_css\"`\n\t\tPublicJS []byte `koanf:\"public.custom_js\"`\n\t}\n\n\tHasLegacyUser bool\n\tAssetVersion string\n\n\tMediaUpload struct {\n\t\tProvider string\n\t\tExtensions []string\n\t}\n\n\tBounceWebhooksEnabled bool\n\tBounceSESEnabled bool\n\tBounceSendgridEnabled bool\n\tBouncePostmarkEnabled bool\n\tBounceForwardemailEnabled bool\n\n\tPermissionsRaw json.RawMessage\n\tPermissions map[string]struct{}\n}\n\n// initFlags initializes the commandline flags into the Koanf instance.\nfunc initFlags(ko *koanf.Koanf) {\n\tf := flag.NewFlagSet(\"config\", flag.ContinueOnError)\n\tf.Usage = func() {\n\t\t// Register --help handler.\n\t\tfmt.Println(f.FlagUsages())\n\t\tos.Exit(0)\n\t}\n\n\t// Register the commandline flags.\n\tf.StringSlice(\"config\", []string{\"config.toml\"},\n\t\t\"path to one or more config files (will be merged in order)\")\n\tf.Bool(\"install\", false, \"setup database (first time)\")\n\tf.Bool(\"idempotent\", false, \"make --install run only if the database isn't already setup\")\n\tf.Bool(\"upgrade\", false, \"upgrade database to the current version\")\n\tf.Bool(\"version\", false, \"show current version of the build\")\n\tf.Bool(\"new-config\", false, \"generate sample config file (at path given in --config)\")\n\tf.String(\"static-dir\", \"\", \"(optional) path to directory with static files\")\n\tf.String(\"i18n-dir\", \"\", \"(optional) path to directory with i18n language files\")\n\tf.Bool(\"yes\", false, \"assume 'yes' to prompts during --install/upgrade\")\n\tf.Bool(\"passive\", false, \"run in passive mode where campaigns are not processed\")\n\tif err := f.Parse(os.Args[1:]); err != nil {\n\t\tlo.Fatalf(\"error loading flags: %v\", err)\n\t}\n\n\tif err := ko.Load(posflag.Provider(f, \".\", ko), nil); err != nil {\n\t\tlo.Fatalf(\"error loading config: %v\", err)\n\t}\n}\n\n// initConfigFiles loads the given config files into the koanf instance.\nfunc initConfigFiles(files []string, ko *koanf.Koanf) {\n\tfor _, f := range files {\n\t\tlo.Printf(\"reading config: %s\", f)\n\t\tif err := ko.Load(file.Provider(f), toml.Parser()); err != nil {\n\t\t\tif os.IsNotExist(err) {\n\t\t\t\tlo.Fatal(\"config file not found. If there isn't one yet, run --new-config to generate one.\")\n\t\t\t}\n\t\t\tlo.Fatalf(\"error loading config from file: %v.\", err)\n\t\t}\n\t}\n}\n\n// initFileSystem initializes the stuffbin FileSystem to provide\n// access to bundled static assets to the app.\nfunc initFS(appDir, frontendDir, staticDir, i18nDir string) stuffbin.FileSystem {\n\tvar (\n\t\t// stuffbin real_path:virtual_alias paths to map local assets on disk\n\t\t// when there an embedded filestystem is not found.\n\n\t\t// These paths are joined with appDir.\n\t\tappFiles = []string{\n\t\t\t\"./config.toml.sample:config.toml.sample\",\n\t\t\t\"./queries:queries\",\n\t\t\t\"./schema.sql:schema.sql\",\n\t\t\t\"./permissions.json:permissions.json\",\n\t\t}\n\n\t\tfrontendFiles = []string{\n\t\t\t// Admin frontend's static assets accessible at /admin/* during runtime.\n\t\t\t// These paths are sourced from frontendDir.\n\t\t\t\"./:/admin\",\n\t\t}\n\n\t\tstaticFiles = []string{\n\t\t\t// These paths are joined with staticDir.\n\t\t\t\"./email-templates:static/email-templates\",\n\t\t\t\"./public:/public\",\n\t\t}\n\n\t\ti18nFiles = []string{\n\t\t\t// These paths are joined with i18nDir.\n\t\t\t\"./:/i18n\",\n\t\t}\n\t)\n\n\t// Get the executable's execPath.\n\texecPath, err := os.Executable()\n\tif err != nil {\n\t\tlo.Fatalf(\"error getting executable path: %v\", err)\n\t}\n\n\t// Load embedded files in the executable.\n\thasEmbed := true\n\tfs, err := stuffbin.UnStuff(execPath)\n\tif err != nil {\n\t\thasEmbed = false\n\n\t\t// Running in local mode. Load local assets into\n\t\t// the in-memory stuffbin.FileSystem.\n\t\tlo.Printf(\"unable to initialize embedded filesystem (%v). Using local filesystem\", err)\n\n\t\tfs, err = stuffbin.NewLocalFS(\"/\")\n\t\tif err != nil {\n\t\t\tlo.Fatalf(\"failed to initialize local file for assets: %v\", err)\n\t\t}\n\t}\n\n\t// If the embed failed, load app and frontend files from the compile-time paths.\n\tfiles := []string{}\n\tif !hasEmbed {\n\t\tfiles = append(files, joinFSPaths(appDir, appFiles)...)\n\t\tfiles = append(files, joinFSPaths(frontendDir, frontendFiles)...)\n\t}\n\n\t// Irrespective of the embeds, if there are user specified static or i18n paths,\n\t// load files from there and override default files (embedded or picked up from CWD).\n\tif !hasEmbed || i18nDir != \"\" {\n\t\tif i18nDir == \"\" {\n\t\t\t// Default dir in cwd.\n\t\t\ti18nDir = \"i18n\"\n\t\t}\n\t\tlo.Printf(\"loading i18n files from: %v\", i18nDir)\n\t\tfiles = append(files, joinFSPaths(i18nDir, i18nFiles)...)\n\t}\n\n\tif !hasEmbed || staticDir != \"\" {\n\t\tif staticDir == \"\" {\n\t\t\t// Default dir in cwd.\n\t\t\tstaticDir = \"static\"\n\t\t} else {\n\t\t\t// There is a custom static directory. Any paths that aren't in it, exclude.\n\t\t\tsf := []string{}\n\t\t\tfor _, def := range staticFiles {\n\t\t\t\ts := strings.Split(def, \":\")[0]\n\t\t\t\tif _, err := os.Stat(path.Join(staticDir, s)); err == nil {\n\t\t\t\t\tsf = append(sf, def)\n\t\t\t\t}\n\t\t\t}\n\t\t\tstaticFiles = sf\n\t\t}\n\n\t\tlo.Printf(\"loading static files from: %v\", staticDir)\n\t\tfiles = append(files, joinFSPaths(staticDir, staticFiles)...)\n\t}\n\n\t// No additional files to load.\n\tif len(files) == 0 {\n\t\treturn fs\n\t}\n\n\t// Load files from disk and overlay into the FS.\n\tfStatic, err := stuffbin.NewLocalFS(\"/\", files...)\n\tif err != nil {\n\t\tlo.Fatalf(\"failed reading static files from disk: '%s': %v\", staticDir, err)\n\t}\n\n\tif err := fs.Merge(fStatic); err != nil {\n\t\tlo.Fatalf(\"error merging static files: '%s': %v\", staticDir, err)\n\t}\n\n\treturn fs\n}\n\n// initDB initializes the main DB connection pool and parse and loads the app's\n// SQL queries into a prepared query map.\nfunc initDB() *sqlx.DB {\n\tvar c struct {\n\t\tHost string `koanf:\"host\"`\n\t\tPort int `koanf:\"port\"`\n\t\tUser string `koanf:\"user\"`\n\t\tPassword string `koanf:\"password\"`\n\t\tDBName string `koanf:\"database\"`\n\t\tSSLMode string `koanf:\"ssl_mode\"`\n\t\tParams string `koanf:\"params\"`\n\t\tMaxOpen int `koanf:\"max_open\"`\n\t\tMaxIdle int `koanf:\"max_idle\"`\n\t\tMaxLifetime time.Duration `koanf:\"max_lifetime\"`\n\t}\n\tif err := ko.Unmarshal(\"db\", &c); err != nil {\n\t\tlo.Fatalf(\"error loading db config: %v\", err)\n\t}\n\n\tlo.Printf(\"connecting to db: %s:%d/%s\", c.Host, c.Port, c.DBName)\n\tdb, err := sqlx.Connect(\"postgres\",\n\t\tfmt.Sprintf(\"host=%s port=%d user=%s password=%s dbname=%s sslmode=%s %s\", c.Host, c.Port, c.User, c.Password, c.DBName, c.SSLMode, c.Params))\n\tif err != nil {\n\t\tlo.Fatalf(\"error connecting to DB: %v\", err)\n\t}\n\n\tdb.SetMaxOpenConns(c.MaxOpen)\n\tdb.SetMaxIdleConns(c.MaxIdle)\n\tdb.SetConnMaxLifetime(c.MaxLifetime)\n\n\treturn db.Unsafe()\n}\n\nfunc readQueries(dir string, fs stuffbin.FileSystem) goyesql.Queries {\n\tout := goyesql.Queries{}\n\n\t// Glob all the .sql files in the queries directory.\n\tqPath := path.Join(dir, \"/*.sql\")\n\tfiles, err := fs.Glob(qPath)\n\tif err != nil {\n\t\tlo.Fatalf(\"error reading *.sql query files from %s: %v\", qPath, err)\n\t}\n\n\t// Read and merge queries from all files into one map.\n\tfor _, file := range files {\n\t\t// Read the SQL file.\n\t\tb, err := fs.Read(file)\n\t\tif err != nil {\n\t\t\tlo.Fatalf(\"error reading SQL file %s: %v\", file, err)\n\t\t}\n\n\t\t// Parse queries in it into a map.\n\t\tmp, err := goyesql.ParseBytes(b)\n\t\tif err != nil {\n\t\t\tlo.Fatalf(\"error parsing SQL queries: %v\", err)\n\t\t}\n\n\t\t// Merge into the main query map.\n\t\tmaps.Copy(out, mp)\n\t}\n\n\treturn out\n}\n\n// prepareQueries queries prepares a query map and returns a *Queries\nfunc prepareQueries(qMap goyesql.Queries, db *sqlx.DB, ko *koanf.Koanf) *models.Queries {\n\tvar (\n\t\tcountQuery = \"get-campaign-analytics-counts\"\n\t\tlinkSel = \"*\"\n\t)\n\tif ko.Bool(\"privacy.individual_tracking\") {\n\t\tcountQuery = \"get-campaign-analytics-unique-counts\"\n\t\tlinkSel = \"DISTINCT subscriber_id\"\n\t}\n\n\t// These don't exist in the SQL file but are in the queries struct to be prepared.\n\tqMap[\"get-campaign-view-counts\"] = &goyesql.Query{\n\t\tQuery: fmt.Sprintf(qMap[countQuery].Query, \"campaign_views\"),\n\t\tTags: map[string]string{\"name\": \"get-campaign-view-counts\"},\n\t}\n\tqMap[\"get-campaign-click-counts\"] = &goyesql.Query{\n\t\tQuery: fmt.Sprintf(qMap[countQuery].Query, \"link_clicks\"),\n\t\tTags: map[string]string{\"name\": \"get-campaign-click-counts\"},\n\t}\n\tqMap[\"get-campaign-link-counts\"].Query = fmt.Sprintf(qMap[\"get-campaign-link-counts\"].Query, linkSel)\n\n\t// Scan and prepare all queries.\n\tvar q models.Queries\n\tif err := goyesqlx.ScanToStruct(&q, qMap, db); err != nil {\n\t\tlo.Fatalf(\"error preparing SQL queries: %v\", err)\n\t}\n\n\treturn &q\n}\n\n// initSettings loads settings from the DB into the given Koanf map.\nfunc initSettings(query string, db *sqlx.DB, ko *koanf.Koanf) {\n\tvar s types.JSONText\n\tif err := db.Get(&s, query); err != nil {\n\t\tmsg := err.Error()\n\t\tif err, ok := err.(*pq.Error); ok {\n\t\t\tif err.Detail != \"\" {\n\t\t\t\tmsg = fmt.Sprintf(\"%s. %s\", err, err.Detail)\n\t\t\t}\n\t\t}\n\n\t\tlo.Fatalf(\"error reading settings from DB: %s\", msg)\n\t}\n\n\t// Setting keys are dot separated, eg: app.favicon_url. Unflatten them into\n\t// nested maps {app: {favicon_url}}.\n\tvar out map[string]any\n\tif err := json.Unmarshal(s, &out); err != nil {\n\t\tlo.Fatalf(\"error unmarshalling settings from DB: %v\", err)\n\t}\n\tif err := ko.Load(confmap.Provider(out, \".\"), nil); err != nil {\n\t\tlo.Fatalf(\"error parsing settings from DB: %v\", err)\n\t}\n}\n\nfunc initUrlConfig(ko *koanf.Koanf) *UrlConfig {\n\troot := strings.TrimSuffix(ko.String(\"app.root_url\"), \"/\")\n\n\treturn &UrlConfig{\n\t\tRootURL: root,\n\t\tLogoURL: ko.String(\"app.logo_url\"),\n\t\tFaviconURL: ko.String(\"app.favicon_url\"),\n\t\tLoginURL: path.Join(uriAdmin, \"/login\"),\n\n\t\t// Static URLS.\n\t\t// url.com/subscription/{campaign_uuid}/{subscriber_uuid}\n\t\tUnsubURL: fmt.Sprintf(\"%s/subscription/%%s/%%s\", root),\n\n\t\t// url.com/subscription/optin/{subscriber_uuid}\n\t\tOptinURL: fmt.Sprintf(\"%s/subscription/optin/%%s?%%s\", root),\n\n\t\t// url.com/link/{campaign_uuid}/{subscriber_uuid}/{link_uuid}\n\t\tLinkTrackURL: fmt.Sprintf(\"%s/link/%%s/%%s/%%s\", root),\n\n\t\t// url.com/link/{campaign_uuid}/{subscriber_uuid}\n\t\tMessageURL: fmt.Sprintf(\"%s/campaign/%%s/%%s\", root),\n\n\t\t// url.com/archive\n\t\tArchiveURL: root + \"/archive\",\n\n\t\t// url.com/campaign/{campaign_uuid}/{subscriber_uuid}/px.png\n\t\tViewTrackURL: fmt.Sprintf(\"%s/campaign/%%s/%%s/px.png\", root),\n\t}\n}\n\n// initConstConfig initializes the app's global constants from the given koanf instance.\nfunc initConstConfig(ko *koanf.Koanf) *Config {\n\t// Read constants.\n\tvar c Config\n\tif err := ko.Unmarshal(\"app\", &c); err != nil {\n\t\tlo.Fatalf(\"error loading app config: %v\", err)\n\t}\n\tif err := ko.Unmarshal(\"privacy\", &c.Privacy); err != nil {\n\t\tlo.Fatalf(\"error loading app.privacy config: %v\", err)\n\t}\n\tif err := ko.Unmarshal(\"security\", &c.Security); err != nil {\n\t\tlo.Fatalf(\"error loading app.security config: %v\", err)\n\t}\n\n\tif err := ko.UnmarshalWithConf(\"appearance\", &c.Appearance, koanf.UnmarshalConf{FlatPaths: true}); err != nil {\n\t\tlo.Fatalf(\"error loading app.appearance config: %v\", err)\n\t}\n\n\tc.Lang = ko.String(\"app.lang\")\n\tc.Privacy.Exportable = koanfmaps.StringSliceToLookupMap(ko.Strings(\"privacy.exportable\"))\n\tc.MediaUpload.Provider = ko.String(\"upload.provider\")\n\tc.MediaUpload.Extensions = ko.Strings(\"upload.extensions\")\n\tc.Privacy.DomainBlocklist = ko.Strings(\"privacy.domain_blocklist\")\n\tc.Privacy.DomainAllowlist = ko.Strings(\"privacy.domain_allowlist\")\n\n\tc.BounceWebhooksEnabled = ko.Bool(\"bounce.webhooks_enabled\")\n\tc.BounceSESEnabled = ko.Bool(\"bounce.ses_enabled\")\n\tc.BounceSendgridEnabled = ko.Bool(\"bounce.sendgrid_enabled\")\n\tc.BouncePostmarkEnabled = ko.Bool(\"bounce.postmark.enabled\")\n\tc.BounceForwardemailEnabled = ko.Bool(\"bounce.forwardemail.enabled\")\n\tc.HasLegacyUser = ko.Exists(\"app.admin_username\") || ko.Exists(\"app.admin_password\")\n\n\tb := md5.Sum([]byte(time.Now().String()))\n\tc.AssetVersion = fmt.Sprintf(\"%x\", b)[0:10]\n\n\tpm, err := fs.Read(\"/permissions.json\")\n\tif err != nil {\n\t\tlo.Fatalf(\"error reading permissions file: %v\", err)\n\t}\n\tc.PermissionsRaw = pm\n\n\t// Make a lookup map of permissions.\n\tpermGroups := []struct {\n\t\tGroup string `json:\"group\"`\n\t\tPermissions []string `json:\"permissions\"`\n\t}{}\n\tif err := json.Unmarshal(pm, &permGroups); err != nil {\n\t\tlo.Fatalf(\"error loading permissions file: %v\", err)\n\t}\n\n\tc.Permissions = map[string]struct{}{}\n\tfor _, group := range permGroups {\n\t\tfor _, g := range group.Permissions {\n\t\t\tc.Permissions[g] = struct{}{}\n\t\t}\n\t}\n\n\treturn &c\n}\n\n// initI18n initializes a new i18n instance with the selected language map\n// loaded from the filesystem. English is a loaded first as the default map\n// and then the selected language is loaded on top of it so that if there are\n// missing translations in it, the default English translations show up.\nfunc initI18n(lang string, fs stuffbin.FileSystem) *i18n.I18n {\n\ti, ok, err := getI18nLang(lang, fs)\n\tif err != nil {\n\t\tif ok {\n\t\t\tlo.Println(err)\n\t\t} else {\n\t\t\tlo.Fatal(err)\n\t\t}\n\t}\n\treturn i\n}\n\n// initCore initializes the CRUD DB core .\nfunc initCore(fnNotify func(sub models.Subscriber, listIDs []int) (int, error), queries *models.Queries, db *sqlx.DB, i *i18n.I18n, ko *koanf.Koanf) *core.Core {\n\topt := &core.Opt{\n\t\tConstants: core.Constants{\n\t\t\tSendOptinConfirmation: ko.Bool(\"app.send_optin_confirmation\"),\n\t\t\tCacheSlowQueries: ko.Bool(\"app.cache_slow_queries\"),\n\t\t},\n\t\tQueries: queries,\n\t\tDB: db,\n\t\tI18n: i,\n\t\tLog: lo,\n\t}\n\n\t// Load bounce config.\n\tif err := ko.Unmarshal(\"bounce.actions\", &opt.Constants.BounceActions); err != nil {\n\t\tlo.Fatalf(\"error unmarshalling bounce config: %v\", err)\n\t}\n\n\t// Initialize the CRUD core.\n\treturn core.New(opt, &core.Hooks{\n\t\tSendOptinConfirmation: fnNotify,\n\t})\n}\n\n// initCampaignManager initializes the campaign manager.\nfunc initCampaignManager(msgrs []manager.Messenger, q *models.Queries, u *UrlConfig, co *core.Core, md media.Store, i *i18n.I18n, ko *koanf.Koanf) *manager.Manager {\n\tif ko.Bool(\"passive\") {\n\t\tlo.Println(\"running in passive mode. won't process campaigns.\")\n\t}\n\n\tmgr := manager.New(manager.Config{\n\t\tBatchSize: ko.Int(\"app.batch_size\"),\n\t\tConcurrency: ko.Int(\"app.concurrency\"),\n\t\tMessageRate: ko.Int(\"app.message_rate\"),\n\t\tMaxSendErrors: ko.Int(\"app.max_send_errors\"),\n\t\tFromEmail: ko.String(\"app.from_email\"),\n\t\tIndividualTracking: ko.Bool(\"privacy.individual_tracking\"),\n\t\tDisableTracking: ko.Bool(\"privacy.disable_tracking\"),\n\t\tUnsubURL: u.UnsubURL,\n\t\tOptinURL: u.OptinURL,\n\t\tLinkTrackURL: u.LinkTrackURL,\n\t\tViewTrackURL: u.ViewTrackURL,\n\t\tMessageURL: u.MessageURL,\n\t\tArchiveURL: u.ArchiveURL,\n\t\tRootURL: u.RootURL,\n\t\tUnsubHeader: ko.Bool(\"privacy.unsubscribe_header\"),\n\t\tSlidingWindow: ko.Bool(\"app.message_sliding_window\"),\n\t\tSlidingWindowDuration: ko.Duration(\"app.message_sliding_window_duration\"),\n\t\tSlidingWindowRate: ko.Int(\"app.message_sliding_window_rate\"),\n\t\tScanInterval: time.Second * 5,\n\t\tScanCampaigns: !ko.Bool(\"passive\"),\n\t}, newManagerStore(q, co, md), i, lo)\n\n\t// Attach all messengers to the campaign manager.\n\tfor _, m := range msgrs {\n\t\tmgr.AddMessenger(m)\n\t}\n\n\treturn mgr\n}\n\n// initTxTemplates initializes and compiles the transactional templates and caches them in-memory.\nfunc initTxTemplates(m *manager.Manager, co *core.Core) {\n\ttpls, err := co.GetTemplates(models.TemplateTypeTx, false)\n\tif err != nil {\n\t\tlo.Fatalf(\"error loading transactional templates: %v\", err)\n\t}\n\n\tfor _, t := range tpls {\n\t\ttpl := t\n\t\tif err := tpl.Compile(m.GenericTemplateFuncs()); err != nil {\n\t\t\tlo.Printf(\"error compiling transactional template %d: %v\", tpl.ID, err)\n\t\t\tcontinue\n\t\t}\n\t\tm.CacheTpl(tpl.ID, &tpl)\n\t}\n}\n\n// initImporter initializes the bulk subscriber importer.\nfunc initImporter(q *models.Queries, db *sqlx.DB, core *core.Core, i *i18n.I18n, ko *koanf.Koanf) *subimporter.Importer {\n\treturn subimporter.New(\n\t\tsubimporter.Options{\n\t\t\tDomainBlocklist: ko.Strings(\"privacy.domain_blocklist\"),\n\t\t\tDomainAllowlist: ko.Strings(\"privacy.domain_allowlist\"),\n\t\t\tUpsertStmt: q.UpsertSubscriber.Stmt,\n\t\t\tBlocklistStmt: q.UpsertBlocklistSubscriber.Stmt,\n\t\t\tUpdateListDateStmt: q.UpdateListsDate.Stmt,\n\n\t\t\t// Hook for triggering admin notifications and refreshing stats materialized\n\t\t\t// views after a successful import.\n\t\t\tPostCB: func(subject string, data any) error {\n\t\t\t\t// Refresh cached subscriber counts and stats.\n\t\t\t\tcore.RefreshMatViews(true)\n\n\t\t\t\t// Send admin notification.\n\t\t\t\tnotifs.NotifySystem(subject, notifs.TplImport, data, nil)\n\t\t\t\treturn nil\n\t\t\t},\n\t\t}, db.DB, i)\n}\n\n// initSMTPMessenger initializes the combined and individual SMTP messengers.\nfunc initSMTPMessengers() []manager.Messenger {\n\tvar (\n\t\tservers = []email.Server{}\n\t\tout = []manager.Messenger{}\n\t)\n\n\t// Load the config for multiple SMTP servers.\n\tfor _, item := range ko.Slices(\"smtp\") {\n\t\tif !item.Bool(\"enabled\") {\n\t\t\tcontinue\n\t\t}\n\n\t\t// Read the SMTP config.\n\t\tvar s email.Server\n\t\tif err := item.UnmarshalWithConf(\"\", &s, koanf.UnmarshalConf{Tag: \"json\"}); err != nil {\n\t\t\tlo.Fatalf(\"error reading SMTP config: %v\", err)\n\t\t}\n\n\t\tservers = append(servers, s)\n\t\tlo.Printf(\"initialized email (SMTP) messenger: %s@%s\", item.String(\"username\"), item.String(\"host\"))\n\n\t\t// If the server has a name, initialize it as a standalone e-mail messenger\n\t\t// allowing campaigns to select individual SMTPs. In the UI and config, it'll appear as `email / $name`.\n\t\tif s.Name != \"\" {\n\t\t\tmsgr, err := email.New(s.Name, s)\n\t\t\tif err != nil {\n\t\t\t\tlo.Fatalf(\"error initializing e-mail messenger: %v\", err)\n\t\t\t}\n\t\t\tout = append(out, msgr)\n\t\t}\n\t}\n\n\t// Initialize the 'email' messenger with all SMTP servers.\n\tmsgr, err := email.New(email.MessengerName, servers...)\n\tif err != nil {\n\t\tlo.Fatalf(\"error initializing e-mail messenger: %v\", err)\n\t}\n\n\t// If it's just one server, return the default \"email\" messenger.\n\tif len(servers) == 1 {\n\t\treturn []manager.Messenger{msgr}\n\t}\n\n\t// If there are multiple servers, prepend the group \"email\" to be the first one.\n\tout = append([]manager.Messenger{msgr}, out...)\n\n\treturn out\n}\n\n// initPostbackMessengers initializes and returns all the enabled\n// HTTP postback messenger backends.\nfunc initPostbackMessengers(ko *koanf.Koanf) []manager.Messenger {\n\titems := ko.Slices(\"messengers\")\n\tif len(items) == 0 {\n\t\treturn nil\n\t}\n\n\tvar out []manager.Messenger\n\tfor _, item := range items {\n\t\tif !item.Bool(\"enabled\") {\n\t\t\tcontinue\n\t\t}\n\n\t\t// Read the Postback server config.\n\t\tvar (\n\t\t\tname = item.String(\"name\")\n\t\t\to postback.Options\n\t\t)\n\t\tif err := item.UnmarshalWithConf(\"\", &o, koanf.UnmarshalConf{Tag: \"json\"}); err != nil {\n\t\t\tlo.Fatalf(\"error reading Postback config: %v\", err)\n\t\t}\n\n\t\t// Initialize the Messenger.\n\t\tp, err := postback.New(o)\n\t\tif err != nil {\n\t\t\tlo.Fatalf(\"error initializing Postback messenger %s: %v\", name, err)\n\t\t}\n\t\tout = append(out, p)\n\n\t\tlo.Printf(\"loaded Postback messenger: %s\", name)\n\t}\n\n\treturn out\n}\n\n// initMediaStore initializes Upload manager with a custom backend.\nfunc initMediaStore(ko *koanf.Koanf) media.Store {\n\tswitch provider := ko.String(\"upload.provider\"); provider {\n\tcase \"s3\":\n\t\tvar o s3.Opt\n\t\tko.Unmarshal(\"upload.s3\", &o)\n\t\to.RootURL = ko.String(\"app.root_url\")\n\n\t\tup, err := s3.NewS3Store(o)\n\t\tif err != nil {\n\t\t\tlo.Fatalf(\"error initializing s3 upload provider %s\", err)\n\t\t}\n\t\tlo.Println(\"media upload provider: s3\")\n\t\treturn up\n\n\tcase \"filesystem\":\n\t\tvar o filesystem.Opts\n\n\t\tko.Unmarshal(\"upload.filesystem\", &o)\n\t\to.RootURL = ko.String(\"app.root_url\")\n\t\to.UploadPath = filepath.Clean(o.UploadPath)\n\t\to.UploadURI = filepath.Clean(o.UploadURI)\n\t\tup, err := filesystem.New(o)\n\t\tif err != nil {\n\t\t\tlo.Fatalf(\"error initializing filesystem upload provider %s\", err)\n\t\t}\n\t\tlo.Println(\"media upload provider: filesystem\")\n\t\treturn up\n\n\tdefault:\n\t\tlo.Fatalf(\"unknown provider. select filesystem or s3\")\n\t}\n\treturn nil\n}\n\n// initNotifs initializes the notifier with the system e-mail templates.\nfunc initNotifs(fs stuffbin.FileSystem, i *i18n.I18n, em *email.Emailer, u *UrlConfig, ko *koanf.Koanf) {\n\ttpls, err := stuffbin.ParseTemplatesGlob(initTplFuncs(i, u), fs, \"/static/email-templates/*.html\")\n\tif err != nil {\n\t\tlo.Fatalf(\"error parsing e-mail notif templates: %v\", err)\n\t}\n\n\t// Read the notification templates.\n\thtml, err := fs.Read(\"/static/email-templates/base.html\")\n\tif err != nil {\n\t\tlo.Fatalf(\"error reading static/email-templates/base.html: %v\", err)\n\t}\n\n\t// Determine whether the notification templates are HTML or plaintext.\n\t// Copy the first few (arbitrary) bytes of the template and check if has the tag.\n\tln := min(len(html), 256)\n\th := make([]byte, ln)\n\tcopy(h, html[0:ln])\n\n\tcontentType := models.CampaignContentTypeHTML\n\tif !bytes.Contains(bytes.ToLower(h), []byte(\" 0 {\n\t\tc.Start()\n\t}\n}\n\n// awaitReload waits for a SIGHUP signal to reload the app. Every setting change on the UI causes a reload.\nfunc awaitReload(sigChan chan os.Signal, closerWait chan bool, closer func()) chan bool {\n\t// The blocking signal handler that main() waits on.\n\tout := make(chan bool)\n\n\t// Respawn a new process and exit the running one.\n\trespawn := func() {\n\t\tif err := syscall.Exec(os.Args[0], os.Args, os.Environ()); err != nil {\n\t\t\tlo.Fatalf(\"error spawning process: %v\", err)\n\t\t}\n\t\tos.Exit(0)\n\t}\n\n\t// Listen for reload signal.\n\tgo func() {\n\t\tfor range sigChan {\n\t\t\tlo.Println(\"reloading on signal ...\")\n\n\t\t\tgo closer()\n\t\t\tselect {\n\t\t\tcase <-closerWait:\n\t\t\t\t// Wait for the closer to finish.\n\t\t\t\trespawn()\n\t\t\tcase <-time.After(time.Second * 3):\n\t\t\t\t// Or timeout and force close.\n\t\t\t\trespawn()\n\t\t\t}\n\t\t}\n\t}()\n\n\treturn out\n}\n\n// initTplFuncs returns a generic template func map with custom template\n// functions and sprig template functions.\nfunc initTplFuncs(i *i18n.I18n, u *UrlConfig) template.FuncMap {\n\tfuncs := template.FuncMap{\n\t\t\"RootURL\": func() string {\n\t\t\treturn u.RootURL\n\t\t},\n\t\t\"LogoURL\": func() string {\n\t\t\treturn u.LogoURL\n\t\t},\n\t\t\"Date\": func(layout string) string {\n\t\t\tif layout == \"\" {\n\t\t\t\tlayout = time.ANSIC\n\t\t\t}\n\t\t\treturn time.Now().Format(layout)\n\t\t},\n\t\t\"L\": func() *i18n.I18n {\n\t\t\treturn i\n\t\t},\n\t\t\"Safe\": func(safeHTML string) template.HTML {\n\t\t\treturn template.HTML(safeHTML)\n\t\t},\n\t}\n\n\t// Copy spring functions.\n\tsprigFuncs := sprig.GenericFuncMap()\n\tdelete(sprigFuncs, \"env\")\n\tdelete(sprigFuncs, \"expandenv\")\n\tdelete(sprigFuncs, \"getHostByName\")\n\n\tmaps.Copy(funcs, sprigFuncs)\n\n\treturn funcs\n}\n\n// initAuth initializes the auth module with the given DB connection and\nfunc initAuth(co *core.Core, db *sql.DB, ko *koanf.Koanf) (bool, *auth.Auth) {\n\tvar oidcCfg auth.OIDCConfig\n\n\t// If OIDC is enabled, set up the OIDC config.\n\tif ko.Bool(\"security.oidc.enabled\") {\n\t\toidcCfg = auth.OIDCConfig{\n\t\t\tEnabled: true,\n\t\t\tProviderURL: ko.String(\"security.oidc.provider_url\"),\n\t\t\tClientID: ko.String(\"security.oidc.client_id\"),\n\t\t\tClientSecret: ko.String(\"security.oidc.client_secret\"),\n\t\t\tAutoCreateUsers: ko.Bool(\"security.oidc.auto_create_users\"),\n\t\t\tDefaultUserRoleID: ko.Int(\"security.oidc.default_user_role_id\"),\n\t\t\tDefaultListRoleID: ko.Int(\"security.oidc.default_list_role_id\"),\n\t\t\tRedirectURL: fmt.Sprintf(\"%s/auth/oidc\", strings.TrimRight(ko.String(\"app.root_url\"), \"/\")),\n\t\t}\n\t}\n\n\t// Setup the sessio manager callbacks for getting and setting cookies.\n\tcb := &auth.Callbacks{\n\t\tGetCookie: func(name string, r any) (*http.Cookie, error) {\n\t\t\tc := r.(echo.Context)\n\t\t\tcookie, err := c.Cookie(name)\n\t\t\treturn cookie, err\n\t\t},\n\t\tSetCookie: func(cookie *http.Cookie, w any) error {\n\t\t\tc := w.(echo.Context)\n\t\t\tcookie.SameSite = http.SameSiteLaxMode\n\t\t\tc.SetCookie(cookie)\n\t\t\treturn nil\n\t\t},\n\t\tGetUser: func(id int) (auth.User, error) {\n\t\t\treturn co.GetUser(id, \"\", \"\")\n\t\t},\n\t}\n\n\t// Initiaize the auth module.\n\ta, err := auth.New(auth.Config{OIDC: oidcCfg}, db, cb, lo)\n\tif err != nil {\n\t\tlo.Fatalf(\"error initializing auth: %v\", err)\n\t}\n\n\t// Cache all API users in-memory for token auth.\n\thasUsers, err := cacheUsers(co, a)\n\tif err != nil {\n\t\tlo.Fatalf(\"error loading API users to cache: %v\", err)\n\t}\n\n\t// If the legacy username+password is set in the TOML file, use that as an API\n\t// access token in the auth module to preserve backwards compatibility for existing\n\t// API integrations. The presence of these values show a red banner on the admin UI\n\t// prompting the creation of new API credentials and the removal of values from\n\t// the TOML config.\n\tvar (\n\t\tusername = ko.String(\"app.admin_username\")\n\t\tpassword = ko.String(\"app.admin_password\")\n\t)\n\tif len(username) > 2 && len(password) > 6 {\n\t\tu := auth.User{\n\t\t\tUsername: username,\n\t\t\tPassword: null.String{Valid: true, String: password},\n\t\t\tPasswordLogin: true,\n\t\t\tHasPassword: true,\n\t\t\tStatus: auth.UserStatusEnabled,\n\t\t\tType: auth.UserTypeAPI,\n\t\t}\n\t\tu.UserRole.ID = auth.SuperAdminRoleID\n\t\ta.CacheAPIUser(u)\n\n\t\tlo.Println(`WARNING: Remove the admin_username and admin_password fields from the TOML configuration file. If you are using APIs, create and use new credentials. Users are now managed via the Admin -> Settings -> Users dashboard.`)\n\t}\n\n\treturn hasUsers, a\n}\n\n// joinFSPaths joins the given paths with the root path and returns the full paths.\nfunc joinFSPaths(root string, paths []string) []string {\n\tout := make([]string, 0, len(paths))\n\tfor _, p := range paths {\n\t\t// real_path:stuffbin_alias\n\t\tf := strings.Split(p, \":\")\n\n\t\tout = append(out, path.Join(root, f[0])+\":\"+f[1])\n\t}\n\n\treturn out\n}\n"
},
{
"path": "cmd/install.go",
"content": "package main\n\nimport (\n\t\"encoding/json\"\n\t\"fmt\"\n\t\"os\"\n\t\"strings\"\n\n\t\"github.com/gofrs/uuid/v5\"\n\t\"github.com/jmoiron/sqlx\"\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/internal/utils\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/knadh/stuffbin\"\n\t\"github.com/lib/pq\"\n\tnull \"gopkg.in/volatiletech/null.v6\"\n)\n\n// install runs the first time setup of setting up the database.\nfunc install(lastVer string, db *sqlx.DB, fs stuffbin.FileSystem, prompt, idempotent bool) {\n\tqMap := readQueries(queryFilePath, fs)\n\n\tfmt.Println(\"\")\n\tif !idempotent {\n\t\tfmt.Println(\"** first time installation **\")\n\t\tfmt.Printf(\"** IMPORTANT: This will wipe existing listmonk tables and types in the DB '%s' **\",\n\t\t\tko.String(\"db.database\"))\n\t} else {\n\t\tfmt.Println(\"** first time (idempotent) installation **\")\n\t}\n\tfmt.Println(\"\")\n\n\tif prompt {\n\t\tvar ok string\n\t\tfmt.Print(\"continue (y/N)? \")\n\t\tif _, err := fmt.Scanf(\"%s\", &ok); err != nil {\n\t\t\tlo.Fatalf(\"error reading value from terminal: %v\", err)\n\t\t}\n\t\tif strings.ToLower(ok) != \"y\" {\n\t\t\tfmt.Println(\"install cancelled.\")\n\t\t\treturn\n\t\t}\n\t}\n\n\t// If idempotence is on, check if the DB is already setup.\n\tif idempotent {\n\t\tif _, err := db.Exec(\"SELECT count(*) FROM settings\"); err != nil {\n\t\t\t// If \"settings\" doesn't exist, assume it's a fresh install.\n\t\t\tif pqErr, ok := err.(*pq.Error); ok && pqErr.Code != \"42P01\" {\n\t\t\t\tlo.Fatalf(\"error checking existing DB schema: %v\", err)\n\t\t\t}\n\t\t} else {\n\t\t\tlo.Println(\"skipping install as database appears to be already setup\")\n\t\t\tos.Exit(0)\n\t\t}\n\t}\n\n\t// Migrate the tables.\n\tif err := installSchema(lastVer, db, fs); err != nil {\n\t\tlo.Fatalf(\"error migrating DB schema: %v\", err)\n\t}\n\n\t// Load the queries.\n\tq := prepareQueries(qMap, db, ko)\n\n\t// Sample list.\n\tdefList, optinList := installLists(q)\n\n\t// Sample subscribers.\n\tinstallSubs(defList, optinList, q)\n\n\t// Templates.\n\tcampTplID, archiveTplID := installTemplates(q)\n\n\t// Sample campaign.\n\tinstallCampaign(campTplID, archiveTplID, q)\n\n\t// Setup admin user optionally.\n\tvar (\n\t\tuser = os.Getenv(\"LISTMONK_ADMIN_USER\")\n\t\tpassword = os.Getenv(\"LISTMONK_ADMIN_PASSWORD\")\n\t\tapiUser = os.Getenv(\"LISTMONK_ADMIN_API_USER\")\n\n\t\thasUser = false\n\t)\n\n\t// Admin user.\n\tif user != \"\" && password != \"\" {\n\t\tif len(user) < 3 || len(password) < 8 {\n\t\t\tlo.Fatal(\"LISTMONK_ADMIN_USER should be min 3 chars and LISTMONK_ADMIN_PASSWORD should be min 8 chars\")\n\t\t}\n\n\t\tlo.Printf(\"creating superadmin user '%s'\", user)\n\t\thasUser = true\n\t} else {\n\t\tlo.Printf(\"no superadmin user created. Visit webpage to create user.\")\n\t}\n\n\t// API User.\n\tif apiUser != \"\" {\n\t\tif !hasUser {\n\t\t\tlo.Fatal(\"LISTMONK_ADMIN_API_USER requires LISTMONK_ADMIN_USER and LISTMONK_ADMIN_PASSWORD to be set\")\n\t\t}\n\n\t\tif len(apiUser) < 3 {\n\t\t\tlo.Fatal(\"LISTMONK_ADMIN_API_USER should be min 3 chars\")\n\t\t}\n\n\t\tlo.Printf(\"creating superadmin API user '%s'\", apiUser)\n\t}\n\n\tif hasUser {\n\t\tinstallUser(user, password, apiUser, q)\n\t}\n\n\tlo.Printf(\"setup complete\")\n\tlo.Printf(`run the program and access the dashboard at %s`, ko.MustString(\"app.address\"))\n}\n\n// installSchema executes the SQL schema and creates the necessary tables and types.\nfunc installSchema(curVer string, db *sqlx.DB, fs stuffbin.FileSystem) error {\n\tq, err := fs.Read(\"/schema.sql\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tif _, err := db.Exec(string(q)); err != nil {\n\t\treturn err\n\t}\n\n\t// Insert the current migration version.\n\treturn recordMigrationVersion(curVer, db)\n}\n\nfunc installLists(q *models.Queries) (int, int) {\n\tvar (\n\t\tdefList int\n\t\toptinList int\n\t)\n\tif err := q.CreateList.Get(&defList,\n\t\tuuid.Must(uuid.NewV4()),\n\t\t\"Default list\",\n\t\tmodels.ListTypePrivate,\n\t\tmodels.ListOptinSingle,\n\t\tmodels.ListStatusActive,\n\t\tpq.StringArray{\"test\"},\n\t\t\"\",\n\t); err != nil {\n\t\tlo.Fatalf(\"error creating list: %v\", err)\n\t}\n\n\tif err := q.CreateList.Get(&optinList, uuid.Must(uuid.NewV4()),\n\t\t\"Opt-in list\",\n\t\tmodels.ListTypePublic,\n\t\tmodels.ListOptinDouble,\n\t\tmodels.ListStatusActive,\n\t\tpq.StringArray{\"test\"},\n\t\t\"\",\n\t); err != nil {\n\t\tlo.Fatalf(\"error creating list: %v\", err)\n\t}\n\n\treturn defList, optinList\n}\n\nfunc installSubs(defListID, optinListID int, q *models.Queries) {\n\t// Sample subscriber.\n\tif _, err := q.UpsertSubscriber.Exec(\n\t\tuuid.Must(uuid.NewV4()),\n\t\t\"john@example.com\",\n\t\t\"John Doe\",\n\t\t`{\"type\": \"known\", \"good\": true, \"city\": \"Bengaluru\"}`,\n\t\tpq.Int64Array{int64(defListID)},\n\t\tmodels.SubscriptionStatusUnconfirmed,\n\t\ttrue, true); err != nil {\n\t\tlo.Fatalf(\"Error creating subscriber: %v\", err)\n\t}\n\tif _, err := q.UpsertSubscriber.Exec(\n\t\tuuid.Must(uuid.NewV4()),\n\t\t\"anon@example.com\",\n\t\t\"Anon Doe\",\n\t\t`{\"type\": \"unknown\", \"good\": true, \"city\": \"Bengaluru\"}`,\n\t\tpq.Int64Array{int64(optinListID)},\n\t\tmodels.SubscriptionStatusUnconfirmed,\n\t\ttrue, true); err != nil {\n\t\tlo.Fatalf(\"error creating subscriber: %v\", err)\n\t}\n}\n\nfunc installTemplates(q *models.Queries) (int, int) {\n\t// Default campaign template.\n\tcampTpl, err := fs.Get(\"/static/email-templates/default.tpl\")\n\tif err != nil {\n\t\tlo.Fatalf(\"error reading default e-mail template: %v\", err)\n\t}\n\n\tvar campTplID int\n\tif err := q.CreateTemplate.Get(&campTplID, \"Default campaign template\", models.TemplateTypeCampaign, \"\", campTpl.ReadBytes(), nil); err != nil {\n\t\tlo.Fatalf(\"error creating default campaign template: %v\", err)\n\t}\n\tif _, err := q.SetDefaultTemplate.Exec(campTplID); err != nil {\n\t\tlo.Fatalf(\"error setting default template: %v\", err)\n\t}\n\n\t// Default campaign archive template.\n\tarchiveTpl, err := fs.Get(\"/static/email-templates/default-archive.tpl\")\n\tif err != nil {\n\t\tlo.Fatalf(\"error reading default archive template: %v\", err)\n\t}\n\n\tvar archiveTplID int\n\tif err := q.CreateTemplate.Get(&archiveTplID, \"Default archive template\", models.TemplateTypeCampaign, \"\", archiveTpl.ReadBytes(), nil); err != nil {\n\t\tlo.Fatalf(\"error creating default campaign template: %v\", err)\n\t}\n\n\t// Sample tx template.\n\ttxTpl, err := fs.Get(\"/static/email-templates/sample-tx.tpl\")\n\tif err != nil {\n\t\tlo.Fatalf(\"error reading default e-mail template: %v\", err)\n\t}\n\n\tif _, err := q.CreateTemplate.Exec(\"Sample transactional template\", models.TemplateTypeTx, \"Welcome {{ .Subscriber.Name }}\", txTpl.ReadBytes(), nil); err != nil {\n\t\tlo.Fatalf(\"error creating sample transactional template: %v\", err)\n\t}\n\n\t// Sample visual campaign template.\n\tvisualTpl, err := fs.Get(\"/static/email-templates/default-visual.tpl\")\n\tif err != nil {\n\t\tlo.Fatalf(\"error reading default visual template: %v\", err)\n\t}\n\tvisualSrc, err := fs.Get(\"/static/email-templates/default-visual.json\")\n\tif err != nil {\n\t\tlo.Fatalf(\"error reading default visual template json: %v\", err)\n\t}\n\n\tif _, err := q.CreateTemplate.Exec(\"Sample visual template\", models.TemplateTypeCampaignVisual, \"\", visualTpl.ReadBytes(), visualSrc.ReadBytes()); err != nil {\n\t\tlo.Fatalf(\"error creating default campaign template: %v\", err)\n\t}\n\n\treturn campTplID, archiveTplID\n}\n\nfunc installCampaign(campTplID, archiveTplID int, q *models.Queries) {\n\t// Sample campaign.\n\tif _, err := q.CreateCampaign.Exec(uuid.Must(uuid.NewV4()),\n\t\tmodels.CampaignTypeRegular,\n\t\t\"Test campaign\",\n\t\t\"Welcome to listmonk\",\n\t\t\"No Reply Hi {{ .Subscriber.FirstName }}!
\n\t\tThis is a test e-mail campaign. Your second name is {{ .Subscriber.LastName }} and you are from {{ .Subscriber.Attribs.city }}.
\n\t\tHere is a tracked link.
\n\t\tUse the link icon in the editor toolbar or when writing raw HTML or Markdown,\n\t\t\tsimply suffix @TrackLink to the end of a URL to turn it into a tracking link. Example:
\n\t\t<a href="https://listmonk.app@TrackLink"></a>\n\t\t
For help, refer to the documentation.
\n\t\t`,\n\t\tnil,\n\t\t\"richtext\",\n\t\tnil,\n\t\tjson.RawMessage(\"[]\"),\n\t\tjson.RawMessage(\"{}\"),\n\t\tpq.StringArray{\"test-campaign\"},\n\t\temailMsgr,\n\t\tcampTplID,\n\t\tpq.Int64Array{1},\n\t\tfalse,\n\t\t\"welcome-to-listmonk\",\n\t\tarchiveTplID,\n\t\t`{\"name\": \"Subscriber\"}`,\n\t\tnil,\n\t\tnil,\n\t); err != nil {\n\t\tlo.Fatalf(\"error creating sample campaign: %v\", err)\n\t}\n\n}\n\n// recordMigrationVersion inserts the given version (of DB migration) into the\n// `migrations` array in the settings table.\nfunc recordMigrationVersion(ver string, db *sqlx.DB) error {\n\t_, err := db.Exec(fmt.Sprintf(`INSERT INTO settings (key, value)\n\tVALUES('migrations', '[\"%s\"]'::JSONB)\n\tON CONFLICT (key) DO UPDATE SET value = settings.value || EXCLUDED.value`, ver))\n\treturn err\n}\n\nfunc newConfigFile(path string) error {\n\tif _, err := os.Stat(path); !os.IsNotExist(err) {\n\t\treturn fmt.Errorf(\"error creating %s: %v\", path, err)\n\t}\n\n\t// Initialize the static file system into which all\n\t// required static assets (.sql, .js files etc.) are loaded.\n\tfs := initFS(appDir, \"\", \"\", \"\")\n\tb, err := fs.Read(\"config.toml.sample\")\n\tif err != nil {\n\t\treturn fmt.Errorf(\"error reading sample config (is binary stuffed?): %v\", err)\n\t}\n\n\treturn os.WriteFile(path, b, 0644)\n}\n\n// checkSchema checks if the DB schema is installed.\nfunc checkSchema(db *sqlx.DB) (bool, error) {\n\tif _, err := db.Exec(`SELECT id FROM templates LIMIT 1`); err != nil {\n\t\tif isTableNotExistErr(err) {\n\t\t\treturn false, nil\n\t\t}\n\t\treturn false, err\n\t}\n\treturn true, nil\n}\n\nfunc installUser(username, password, apiUsername string, q *models.Queries) {\n\tconsts := initConstConfig(ko)\n\n\t// Super Admin role gets all permissions.\n\tperms := []string{}\n\tfor p := range consts.Permissions {\n\t\tperms = append(perms, p)\n\t}\n\n\t// Create the Super Admin role in the DB.\n\tvar role auth.Role\n\tif err := q.CreateRole.Get(&role, \"Super Admin\", auth.RoleTypeUser, pq.Array(perms)); err != nil {\n\t\tlo.Fatalf(\"error creating super admin role: %v\", err)\n\t}\n\n\t// Create the admin user.\n\tif _, err := q.CreateUser.Exec(username, true, password, username+\"@listmonk\", username, auth.RoleTypeUser, role.ID, nil, auth.UserStatusEnabled); err != nil {\n\t\tlo.Fatalf(\"error creating superadmin user: %v\", err)\n\t}\n\n\t// Create the admin API user.\n\tif apiUsername != \"\" {\n\t\t// Generate a random API token.\n\t\ttk, err := utils.GenerateRandomString(32)\n\t\tif err != nil {\n\t\t\tlo.Fatalf(\"error generating API token: %v\", err)\n\t\t}\n\n\t\tvar (\n\t\t\temail = null.String{String: apiUsername + \"@api\", Valid: true}\n\t\t\tpassword = null.String{String: tk, Valid: true}\n\t\t)\n\n\t\tif _, err := q.CreateUser.Exec(apiUsername, false, password, email, apiUsername, auth.UserTypeAPI, role.ID, nil, auth.UserStatusEnabled); err != nil {\n\t\t\tlo.Fatalf(\"error creating superadmin API user: %v\", err)\n\t\t}\n\n\t\t// Print the token to stdout so that it can be grepped out.\n\t\tlo.Println(\"writing API token LISTMONK_ADMIN_API_TOKEN to stderr\")\n\t\tfmt.Fprintf(os.Stderr, \"export LISTMONK_ADMIN_API_TOKEN=\\\"%s\\\"\\n\", tk)\n\t}\n}\n" }, { "path": "cmd/lists.go", "content": "package main\n\nimport (\n\t\"net/http\"\n\t\"strconv\"\n\t\"strings\"\n\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n)\n\n// GetLists retrieves lists with additional metadata like subscriber counts.\nfunc (a *App) GetLists(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Get the list IDs (or blanket permission) the user has access to.\n\thasAllPerm, permittedIDs := user.GetPermittedLists(auth.PermTypeGet)\n\n\t// Minimal query simply returns the list of all lists without JOIN subscriber counts. This is fast.\n\tminimal, _ := strconv.ParseBool(c.FormValue(\"minimal\"))\n\tif minimal {\n\t\tstatus := c.FormValue(\"status\")\n\t\tres, err := a.core.GetLists(\"\", status, hasAllPerm, permittedIDs)\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif len(res) == 0 {\n\t\t\treturn c.JSON(http.StatusOK, okResp{[]struct{}{}})\n\t\t}\n\n\t\t// Meta.\n\t\ttotal := len(res)\n\t\tout := models.PageResults{\n\t\t\tResults: res,\n\t\t\tTotal: total,\n\t\t\tPage: 1,\n\t\t\tPerPage: total,\n\t\t}\n\n\t\treturn c.JSON(http.StatusOK, okResp{out})\n\t}\n\n\t// Full list query.\n\tvar (\n\t\tquery = strings.TrimSpace(c.FormValue(\"query\"))\n\t\ttags = c.QueryParams()[\"tag\"]\n\t\torderBy = c.FormValue(\"order_by\")\n\t\ttyp = c.FormValue(\"type\")\n\t\toptin = c.FormValue(\"optin\")\n\t\tstatus = c.FormValue(\"status\")\n\t\torder = c.FormValue(\"order\")\n\n\t\tpg = a.pg.NewFromURL(c.Request().URL.Query())\n\t)\n\tres, total, err := a.core.QueryLists(query, typ, optin, status, tags, orderBy, order, hasAllPerm, permittedIDs, pg.Offset, pg.Limit)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tout := models.PageResults{\n\t\tQuery: query,\n\t\tResults: res,\n\t\tTotal: total,\n\t\tPage: pg.Page,\n\t\tPerPage: pg.PerPage,\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetList retrieves a single list by id.\n// It's permission checked by the listPerm middleware.\nfunc (a *App) GetList(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Check if the user has access to the list.\n\tid := getID(c)\n\tif err := user.HasListPerm(auth.PermTypeGet, id); err != nil {\n\t\treturn err\n\t}\n\n\t// Get the list from the DB.\n\tout, err := a.core.GetList(id, \"\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// CreateList handles list creation.\nfunc (a *App) CreateList(c echo.Context) error {\n\tl := models.List{}\n\tif err := c.Bind(&l); err != nil {\n\t\treturn err\n\t}\n\n\t// Validate.\n\tif !strHasLen(l.Name, 1, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"lists.invalidName\"))\n\t}\n\n\tout, err := a.core.CreateList(l)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// UpdateList handles list modification.\n// It's permission checked by the listPerm middleware.\nfunc (a *App) UpdateList(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Check if the user has access to the list.\n\tid := getID(c)\n\tif err := user.HasListPerm(auth.PermTypeManage, id); err != nil {\n\t\treturn err\n\t}\n\n\t// Incoming params.\n\tvar l models.List\n\tif err := c.Bind(&l); err != nil {\n\t\treturn err\n\t}\n\n\t// Validate.\n\tif !strHasLen(l.Name, 1, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"lists.invalidName\"))\n\t}\n\n\t// Update the list in the DB.\n\tout, err := a.core.UpdateList(id, l)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// DeleteList deletes a single list by ID.\nfunc (a *App) DeleteList(c echo.Context) error {\n\tid := getID(c)\n\n\t// Check if the user has manage permission for the list.\n\tuser := auth.GetUser(c)\n\tif err := user.HasListPerm(auth.PermTypeManage, id); err != nil {\n\t\treturn err\n\t}\n\n\t// Delete the list from the DB.\n\t// Pass getAll=true since we've already verified permissions above.\n\tif err := a.core.DeleteLists([]int{id}, \"\", true, nil); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DeleteLists deletes multiple lists by IDs or by query.\nfunc (a *App) DeleteLists(c echo.Context) error {\n\tuser := auth.GetUser(c)\n\n\tvar (\n\t\tids []int\n\t\tquery string\n\t\tall bool\n\t)\n\n\t// Check for IDs in query params.\n\tif len(c.Request().URL.Query()[\"id\"]) > 0 {\n\t\tvar err error\n\t\tids, err = parseStringIDs(c.Request().URL.Query()[\"id\"])\n\t\tif err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", err.Error()))\n\t\t}\n\t} else {\n\t\t// Check for query param.\n\t\tquery = strings.TrimSpace(c.FormValue(\"query\"))\n\t\tall = c.FormValue(\"all\") == \"true\"\n\t}\n\n\t// Validate that either IDs or query is provided.\n\tif len(ids) == 0 && (query == \"\" && !all) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", \"id or query required\"))\n\t}\n\n\t// For ID deletion, check if the user has manage permission for the specific lists.\n\tif len(ids) > 0 {\n\t\tif err := user.HasListPerm(auth.PermTypeManage, ids...); err != nil {\n\t\t\treturn err\n\t\t}\n\n\t\t// Delete the lists from the DB.\n\t\t// Pass getAll=true since we've already verified permissions above.\n\t\tif err := a.core.DeleteLists(ids, \"\", true, nil); err != nil {\n\t\t\treturn err\n\t\t}\n\t} else {\n\t\t// For query deletion, get the list IDs the user has manage permission for.\n\t\thasAllPerm, permittedIDs := user.GetPermittedLists(auth.PermTypeManage)\n\n\t\t// Delete the lists from the DB with permission filtering.\n\t\tif err := a.core.DeleteLists(nil, query, hasAllPerm, permittedIDs); err != nil {\n\t\t\treturn err\n\t\t}\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n" }, { "path": "cmd/main.go", "content": "package main\n\nimport (\n\t\"context\"\n\t\"fmt\"\n\t\"io\"\n\t\"log\"\n\t\"os\"\n\t\"os/signal\"\n\t\"strings\"\n\t\"sync\"\n\t\"syscall\"\n\t\"time\"\n\n\t\"github.com/jmoiron/sqlx\"\n\t\"github.com/knadh/koanf/providers/env\"\n\t\"github.com/knadh/koanf/v2\"\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/internal/bounce\"\n\t\"github.com/knadh/listmonk/internal/buflog\"\n\t\"github.com/knadh/listmonk/internal/captcha\"\n\t\"github.com/knadh/listmonk/internal/core\"\n\t\"github.com/knadh/listmonk/internal/events\"\n\t\"github.com/knadh/listmonk/internal/i18n\"\n\t\"github.com/knadh/listmonk/internal/manager\"\n\t\"github.com/knadh/listmonk/internal/media\"\n\t\"github.com/knadh/listmonk/internal/messenger/email\"\n\t\"github.com/knadh/listmonk/internal/subimporter\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/knadh/paginator\"\n\t\"github.com/knadh/stuffbin\"\n)\n\n// App contains the \"global\" shared components, controllers and fields.\ntype App struct {\n\tcfg *Config\n\turlCfg *UrlConfig\n\tfs stuffbin.FileSystem\n\tdb *sqlx.DB\n\tqueries *models.Queries\n\tcore *core.Core\n\tmanager *manager.Manager\n\tmessengers []manager.Messenger\n\temailMsgr manager.Messenger\n\timporter *subimporter.Importer\n\tauth *auth.Auth\n\tmedia media.Store\n\tbounce *bounce.Manager\n\tcaptcha *captcha.Captcha\n\ti18n *i18n.I18n\n\tpg *paginator.Paginator\n\tevents *events.Events\n\tlog *log.Logger\n\tbufLog *buflog.BufLog\n\n\tabout about\n\tfnOptinNotify func(models.Subscriber, []int) (int, error)\n\n\t// Channel for passing reload signals.\n\tchReload chan os.Signal\n\n\t// Global variable that stores the state indicating that a restart is required\n\t// after a settings update.\n\tneedsRestart bool\n\n\t// First time installation with no user records in the DB. Needs user setup.\n\tneedsUserSetup bool\n\n\t// Global state that stores data on an available remote update.\n\tupdate *AppUpdate\n\tsync.Mutex\n}\n\nvar (\n\t// Buffered log writer for storing N lines of log entries for the UI.\n\tevStream = events.New()\n\tbufLog = buflog.New(5000)\n\tlo = log.New(io.MultiWriter(os.Stdout, bufLog, evStream.ErrWriter()), \"\", log.Ldate|log.Ltime|log.Lmicroseconds|log.Lshortfile)\n\n\tko = koanf.New(\".\")\n\tfs stuffbin.FileSystem\n\tdb *sqlx.DB\n\tqueries *models.Queries\n\n\t// Compile-time variables.\n\tbuildString string\n\tversionString string\n\n\t// If these are set in build ldflags and static assets (*.sql, config.toml.sample. ./frontend)\n\t// are not embedded (in make dist), these paths are looked up. The default values before, when not\n\t// overridden by build flags, are relative to the CWD at runtime.\n\tappDir string = \".\"\n\tfrontendDir string = \"frontend/dist\"\n)\n\nfunc init() {\n\t// Initialize commandline flags.\n\tinitFlags(ko)\n\n\t// Display version.\n\tif ko.Bool(\"version\") {\n\t\tfmt.Println(buildString)\n\t\tos.Exit(0)\n\t}\n\n\tlo.Println(buildString)\n\n\t// Generate new config.\n\tif ko.Bool(\"new-config\") {\n\t\tpath := ko.Strings(\"config\")[0]\n\t\tif err := newConfigFile(path); err != nil {\n\t\t\tlo.Println(err)\n\t\t\tos.Exit(1)\n\t\t}\n\t\tlo.Printf(\"generated %s. Edit and run --install\", path)\n\t\tos.Exit(0)\n\t}\n\n\t// Load config files to pick up the database settings first.\n\tinitConfigFiles(ko.Strings(\"config\"), ko)\n\n\t// Load environment variables and merge into the loaded config.\n\t// LISTMONK_foo__bar -> foo.bar (double underscore becomes dot for nested config)\n\t// LISTMONK_static_dir -> static-dir (top-level keys with underscore become hyphen for CLI flags)\n\tif err := ko.Load(env.Provider(\"LISTMONK_\", \".\", func(s string) string {\n\t\tkey := strings.ToLower(strings.TrimPrefix(s, \"LISTMONK_\"))\n\t\tkey = strings.Replace(key, \"__\", \".\", -1)\n\t\t// Only convert underscore to hyphen for top-level keys (CLI flags like static-dir, i18n-dir)\n\t\t// Nested config keys (containing dots) keep underscores (e.g., db.ssl_mode)\n\t\tif !strings.Contains(key, \".\") {\n\t\t\tkey = strings.Replace(key, \"_\", \"-\", -1)\n\t\t}\n\t\treturn key\n\t}), nil); err != nil {\n\t\tlo.Fatalf(\"error loading config from env: %v\", err)\n\t}\n\n\t// Connect to the database.\n\tdb = initDB()\n\n\t// Initialize the embedded filesystem with static assets.\n\tfs = initFS(appDir, frontendDir, ko.String(\"static-dir\"), ko.String(\"i18n-dir\"))\n\n\t// Installer mode? This runs before the SQL queries are loaded and prepared\n\t// as the installer needs to work on an empty DB.\n\tif ko.Bool(\"install\") {\n\t\t// Save the version of the last listed migration.\n\t\tinstall(migList[len(migList)-1].version, db, fs, !ko.Bool(\"yes\"), ko.Bool(\"idempotent\"))\n\t\tos.Exit(0)\n\t}\n\n\t// Is this a nightly build?\n\tisNightly := strings.Contains(versionString, \"nightly\")\n\n\t// Check if the DB schema is installed.\n\tif ok, err := checkSchema(db); err != nil {\n\t\tlog.Fatalf(\"error checking schema in DB: %v\", err)\n\t} else if !ok {\n\t\tlo.Fatal(\"the database does not appear to be setup. Run --install.\")\n\t}\n\n\tif ko.Bool(\"upgrade\") {\n\t\t// Even on explicit upgrade runs, for nightly builds, do not record the last\n\t\t// migration version in the DB.\n\t\tlo.Printf(\"running upgrade...\")\n\t\tupgrade(db, fs, !ko.Bool(\"yes\"), !isNightly)\n\t\tos.Exit(0)\n\t}\n\n\t// For nightly builds, always auto-run pending migrations without\n\t// recording the last version in the DB. Migrations are idempotent, and between\n\t// nightly releases, they may change multiple times.\n\tif isNightly {\n\t\tlo.Printf(\"auto-running all migrations for nightly %s since last major version\", versionString)\n\t\tupgrade(db, fs, false, false)\n\t} else {\n\t\t// Before the queries are prepared, see if there are pending upgrades.\n\t\tcheckUpgrade(db)\n\t}\n\n\t// Read the SQL queries from the queries file.\n\tqMap := readQueries(queryFilePath, fs)\n\n\t// Load settings from DB.\n\tif q, ok := qMap[\"get-settings\"]; ok {\n\t\tinitSettings(q.Query, db, ko)\n\t}\n\n\t// Prepare queries.\n\tqueries = prepareQueries(qMap, db, ko)\n}\n\nfunc main() {\n\tvar (\n\t\t// Initialize static global config.\n\t\tcfg = initConstConfig(ko)\n\n\t\t// Initialize static URL config.\n\t\turlCfg = initUrlConfig(ko)\n\n\t\t// Initialize i18n language map.\n\t\ti18n = initI18n(ko.MustString(\"app.lang\"), fs)\n\n\t\t// Initialize the media store.\n\t\tmedia = initMediaStore(ko)\n\n\t\tfbOptinNotify = makeOptinNotifyHook(ko.Bool(\"privacy.unsubscribe_header\"), urlCfg, queries, i18n)\n\n\t\t// Crud core.\n\t\tcore = initCore(fbOptinNotify, queries, db, i18n, ko)\n\n\t\t// Initialize all messengers, SMTP and postback.\n\t\tmsgrs = append(initSMTPMessengers(), initPostbackMessengers(ko)...)\n\n\t\t// Campaign manager.\n\t\tmgr = initCampaignManager(msgrs, queries, urlCfg, core, media, i18n, ko)\n\n\t\t// Bulk importer.\n\t\timporter = initImporter(queries, db, core, i18n, ko)\n\n\t\t// Initialize the auth manager.\n\t\thasUsers, auth = initAuth(core, db.DB, ko)\n\n\t\t// Initialize the webhook/POP3 bounce processor.\n\t\tbounce *bounce.Manager\n\n\t\temailMsgr *email.Emailer\n\n\t\tchReload = make(chan os.Signal, 1)\n\t)\n\n\t// Initialize the bounce manager that processes bounces from webhooks and\n\t// POP3 mailbox scanning.\n\tif ko.Bool(\"bounce.enabled\") {\n\t\tbounce = initBounceManager(core.RecordBounce, queries.RecordBounce, lo, ko)\n\t}\n\n\t// Assign the default `email` messenger to the app.\n\tfor _, m := range msgrs {\n\t\tif m.Name() == \"email\" {\n\t\t\temailMsgr = m.(*email.Emailer)\n\t\t}\n\t}\n\n\t// Initialize the global admin/sub e-mail notifier.\n\tinitNotifs(fs, i18n, emailMsgr, urlCfg, ko)\n\n\t// Initialize and cache tx templates in memory.\n\tinitTxTemplates(mgr, core)\n\n\t// Initialize the bounce manager that processes bounces from webhooks and\n\t// POP3 mailbox scanning.\n\tif ko.Bool(\"bounce.enabled\") {\n\t\tgo bounce.Run()\n\t}\n\n\t// Start cronjobs.\n\tinitCron(core, db)\n\n\t// Start the campaign manager workers. The campaign batches (fetch from DB, push out\n\t// messages) get processed at the specified interval.\n\tgo mgr.Run()\n\n\t// =========================================================================\n\t// Initialize the App{} with all the global shared components, controllers and fields.\n\tapp := &App{\n\t\tcfg: cfg,\n\t\turlCfg: urlCfg,\n\t\tfs: fs,\n\t\tdb: db,\n\t\tqueries: queries,\n\t\tcore: core,\n\t\tmanager: mgr,\n\t\tmessengers: msgrs,\n\t\temailMsgr: emailMsgr,\n\t\timporter: importer,\n\t\tauth: auth,\n\t\tmedia: media,\n\t\tbounce: bounce,\n\t\tcaptcha: initCaptcha(),\n\t\ti18n: i18n,\n\t\tlog: lo,\n\t\tevents: evStream,\n\t\tbufLog: bufLog,\n\n\t\tpg: paginator.New(paginator.Opt{\n\t\t\tDefaultPerPage: 20,\n\t\t\tMaxPerPage: 50,\n\t\t\tNumPageNums: 10,\n\t\t\tPageParam: \"page\",\n\t\t\tPerPageParam: \"per_page\",\n\t\t\tAllowAll: true,\n\t\t}),\n\n\t\tfnOptinNotify: fbOptinNotify,\n\t\tabout: initAbout(queries, db),\n\t\tchReload: chReload,\n\n\t\t// If there are no users, then the app needs to prompt for new user setup.\n\t\tneedsUserSetup: !hasUsers,\n\t}\n\n\t// Star the update checker.\n\tif ko.Bool(\"app.check_updates\") {\n\t\tgo app.checkUpdates(versionString, time.Hour*24)\n\t}\n\n\t// Start the app server.\n\tsrv := initHTTPServer(cfg, urlCfg, i18n, fs, app)\n\n\t// =========================================================================\n\t// Wait for the reload signal with a callback to gracefully shut down resources.\n\t// The `wait` channel is passed to awaitReload to wait for the callback to finish\n\t// within N seconds, or do a force reload.\n\tsignal.Notify(chReload, syscall.SIGHUP)\n\n\tcloserWait := make(chan bool)\n\t<-awaitReload(chReload, closerWait, func() {\n\t\t// Stop the HTTP server.\n\t\tctx, cancel := context.WithTimeout(context.Background(), 1*time.Second)\n\t\tdefer cancel()\n\t\tsrv.Shutdown(ctx)\n\n\t\t// Close the campaign manager.\n\t\tmgr.Close()\n\n\t\t// Close the DB pool.\n\t\tdb.Close()\n\n\t\t// Close the messenger pool.\n\t\tfor _, m := range app.messengers {\n\t\t\tm.Close()\n\t\t}\n\n\t\t// Signal the close.\n\t\tcloserWait <- true\n\t})\n}\n" }, { "path": "cmd/maintenance.go", "content": "package main\n\nimport (\n\t\"log\"\n\t\"net/http\"\n\t\"time\"\n\n\t\"github.com/jmoiron/sqlx\"\n\t\"github.com/labstack/echo/v4\"\n)\n\n// GCSubscribers garbage collects (deletes) orphaned or blocklisted subscribers.\nfunc (a *App) GCSubscribers(c echo.Context) error {\n\tvar (\n\t\ttyp = c.Param(\"type\")\n\n\t\tn int\n\t\terr error\n\t)\n\n\tswitch typ {\n\tcase \"blocklisted\":\n\t\tn, err = a.core.DeleteBlocklistedSubscribers()\n\tcase \"orphan\":\n\t\tn, err = a.core.DeleteOrphanSubscribers()\n\tdefault:\n\t\terr = echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t}\n\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{struct {\n\t\tCount int `json:\"count\"`\n\t}{n}})\n}\n\n// GCSubscriptions garbage collects (deletes) orphaned or blocklisted subscribers.\nfunc (a *App) GCSubscriptions(c echo.Context) error {\n\t// Validate the date.\n\tt, err := time.Parse(time.RFC3339, c.FormValue(\"before_date\"))\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t}\n\n\t// Delete unconfirmed subscriptions from the DB in bulk.\n\tn, err := a.core.DeleteUnconfirmedSubscriptions(t)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{struct {\n\t\tCount int `json:\"count\"`\n\t}{n}})\n}\n\n// GCCampaignAnalytics garbage collects (deletes) campaign analytics.\nfunc (a *App) GCCampaignAnalytics(c echo.Context) error {\n\n\tt, err := time.Parse(time.RFC3339, c.FormValue(\"before_date\"))\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t}\n\n\tswitch c.Param(\"type\") {\n\tcase \"all\":\n\t\tif err := a.core.DeleteCampaignViews(t); err != nil {\n\t\t\treturn err\n\t\t}\n\t\terr = a.core.DeleteCampaignLinkClicks(t)\n\tcase \"views\":\n\t\terr = a.core.DeleteCampaignViews(t)\n\tcase \"clicks\":\n\t\terr = a.core.DeleteCampaignLinkClicks(t)\n\tdefault:\n\t\terr = echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t}\n\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// RunDBVacuum runs a full VACUUM on the PostgreSQL database.\n// VACUUM reclaims storage occupied by dead tuples and updates planner statistics.\nfunc RunDBVacuum(db *sqlx.DB, lo *log.Logger) {\n\tlo.Println(\"running database VACUUM ANALYZE\")\n\tif _, err := db.Exec(\"VACUUM ANALYZE\"); err != nil {\n\t\tlo.Printf(\"error running VACUUM ANALYZE: %v\", err)\n\t\treturn\n\t}\n\tlo.Println(\"finished database VACUUM ANALYZE\")\n}\n" }, { "path": "cmd/manager_store.go", "content": "package main\n\nimport (\n\t\"github.com/gofrs/uuid/v5\"\n\t\"github.com/knadh/listmonk/internal/core\"\n\t\"github.com/knadh/listmonk/internal/manager\"\n\t\"github.com/knadh/listmonk/internal/media\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/lib/pq\"\n)\n\n// store implements DataSource over the primary\n// database.\ntype store struct {\n\tqueries *models.Queries\n\tcore *core.Core\n\tmedia media.Store\n}\n\ntype runningCamp struct {\n\tCampaignID int `db:\"campaign_id\"`\n\tCampaignType string `db:\"campaign_type\"`\n\tLastSubscriberID int `db:\"last_subscriber_id\"`\n\tMaxSubscriberID int `db:\"max_subscriber_id\"`\n\tListID int `db:\"list_id\"`\n}\n\nfunc newManagerStore(q *models.Queries, c *core.Core, m media.Store) *store {\n\treturn &store{\n\t\tqueries: q,\n\t\tcore: c,\n\t\tmedia: m,\n\t}\n}\n\n// NextCampaigns retrieves active campaigns ready to be processed excluding\n// campaigns that are also being processed. Additionally, it takes a map of campaignID:sentCount\n// of campaigns that are being processed and updates them in the DB.\nfunc (s *store) NextCampaigns(currentIDs []int64, sentCounts []int64) ([]*models.Campaign, error) {\n\tvar out []*models.Campaign\n\terr := s.queries.NextCampaigns.Select(&out, pq.Int64Array(currentIDs), pq.Int64Array(sentCounts))\n\treturn out, err\n}\n\n// NextSubscribers retrieves a subset of subscribers of a given campaign.\n// Since batches are processed sequentially, the retrieval is ordered by ID,\n// and every batch takes the last ID of the last batch and fetches the next\n// batch above that.\nfunc (s *store) NextSubscribers(campID, limit int) ([]models.Subscriber, error) {\n\tvar camps []runningCamp\n\tif err := s.queries.GetRunningCampaign.Select(&camps, campID); err != nil {\n\t\treturn nil, err\n\t}\n\n\tvar listIDs []int\n\tfor _, c := range camps {\n\t\tlistIDs = append(listIDs, c.ListID)\n\t}\n\n\tif len(listIDs) == 0 {\n\t\treturn nil, nil\n\t}\n\n\tvar out []models.Subscriber\n\terr := s.queries.NextCampaignSubscribers.Select(&out, camps[0].CampaignID, camps[0].CampaignType, camps[0].LastSubscriberID, camps[0].MaxSubscriberID, pq.Array(listIDs), limit)\n\treturn out, err\n}\n\n// GetCampaign fetches a campaign from the database.\nfunc (s *store) GetCampaign(campID int) (*models.Campaign, error) {\n\tvar out = &models.Campaign{}\n\terr := s.queries.GetCampaign.Get(out, campID, nil, nil, \"default\")\n\treturn out, err\n}\n\n// UpdateCampaignStatus updates a campaign's status.\nfunc (s *store) UpdateCampaignStatus(campID int, status string) error {\n\t_, err := s.queries.UpdateCampaignStatus.Exec(campID, status)\n\treturn err\n}\n\n// UpdateCampaignCounts updates a campaign's status.\nfunc (s *store) UpdateCampaignCounts(campID int, toSend int, sent int, lastSubID int) error {\n\t_, err := s.queries.UpdateCampaignCounts.Exec(campID, toSend, sent, lastSubID)\n\treturn err\n}\n\n// GetAttachment fetches a media attachment blob.\nfunc (s *store) GetAttachment(mediaID int) (models.Attachment, error) {\n\tm, err := s.core.GetMedia(mediaID, \"\", \"\", s.media)\n\tif err != nil {\n\t\treturn models.Attachment{}, err\n\t}\n\n\tb, err := s.media.GetBlob(m.URL)\n\tif err != nil {\n\t\treturn models.Attachment{}, err\n\t}\n\n\treturn models.Attachment{\n\t\tName: m.Filename,\n\t\tContent: b,\n\t\tHeader: manager.MakeAttachmentHeader(m.Filename, \"base64\", m.ContentType),\n\t}, nil\n}\n\n// CreateLink registers a URL with a UUID for tracking clicks and returns the UUID.\nfunc (s *store) CreateLink(url string) (string, error) {\n\t// Create a new UUID for the URL. If the URL already exists in the DB\n\t// the UUID in the database is returned.\n\tuu, err := uuid.NewV4()\n\tif err != nil {\n\t\treturn \"\", err\n\t}\n\n\tvar out string\n\tif err := s.queries.CreateLink.Get(&out, uu, url); err != nil {\n\t\treturn \"\", err\n\t}\n\n\treturn out, nil\n}\n\n// RecordBounce records a bounce event and returns the bounce count.\nfunc (s *store) RecordBounce(b models.Bounce) (int64, int, error) {\n\tvar res = struct {\n\t\tSubscriberID int64 `db:\"subscriber_id\"`\n\t\tNum int `db:\"num\"`\n\t}{}\n\n\terr := s.queries.UpdateCampaignStatus.Select(&res,\n\t\tb.SubscriberUUID,\n\t\tb.Email,\n\t\tb.CampaignUUID,\n\t\tb.Type,\n\t\tb.Source,\n\t\tb.Meta)\n\n\treturn res.SubscriberID, res.Num, err\n}\n\n// BlocklistSubscriber blocklists a subscriber permanently.\nfunc (s *store) BlocklistSubscriber(id int64) error {\n\t_, err := s.queries.BlocklistSubscribers.Exec(pq.Int64Array{id})\n\treturn err\n}\n\n// DeleteSubscriber deletes a subscriber from the DB.\nfunc (s *store) DeleteSubscriber(id int64) error {\n\t_, err := s.queries.DeleteSubscribers.Exec(pq.Int64Array{id})\n\treturn err\n}\n" }, { "path": "cmd/media.go", "content": "package main\n\nimport (\n\t\"bytes\"\n\t\"mime/multipart\"\n\t\"net/http\"\n\t\"path/filepath\"\n\t\"strings\"\n\n\t\"github.com/disintegration/imaging\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n)\n\nconst (\n\tthumbPrefix = \"thumb_\"\n\tthumbnailSize = 250\n)\n\nvar (\n\tvectorExts = []string{\"svg\"}\n\timageExts = []string{\"gif\", \"png\", \"jpg\", \"jpeg\"}\n)\n\n// UploadMedia handles media file uploads.\nfunc (a *App) UploadMedia(c echo.Context) error {\n\tfile, err := c.FormFile(\"file\")\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"media.invalidFile\", \"error\", err.Error()))\n\t}\n\n\t// Read the file from the HTTP form.\n\tsrc, err := file.Open()\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\ta.i18n.Ts(\"media.errorReadingFile\", \"error\", err.Error()))\n\t}\n\tdefer src.Close()\n\n\tvar (\n\t\t// Naive check for content type and extension.\n\t\text = strings.TrimPrefix(strings.ToLower(filepath.Ext(file.Filename)), \".\")\n\t\tcontentType = file.Header.Get(\"Content-Type\")\n\t)\n\n\t// Validate file extension.\n\tif !inArray(\"*\", a.cfg.MediaUpload.Extensions) {\n\t\tif ok := inArray(ext, a.cfg.MediaUpload.Extensions); !ok {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"media.unsupportedFileType\", \"type\", ext))\n\t\t}\n\t}\n\n\t// Sanitize the filename.\n\tfName := makeFilename(file.Filename)\n\n\t// If the filename already exists in the DB, make it unique by adding a random suffix.\n\tif _, err := a.core.GetMedia(0, \"\", fName, a.media); err == nil {\n\t\tsuffix, err := generateRandomString(6)\n\t\tif err != nil {\n\t\t\ta.log.Printf(\"error generating random string: %v\", err)\n\t\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"globals.messages.internalError\"))\n\t\t}\n\n\t\tfName = appendSuffixToFilename(fName, suffix)\n\t}\n\n\t// Upload the file to the media store.\n\tfName, err = a.media.Put(fName, contentType, src)\n\tif err != nil {\n\t\ta.log.Printf(\"error uploading file: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\ta.i18n.Ts(\"media.errorUploading\", \"error\", err.Error()))\n\t}\n\n\t// This keeps track of whether the file has to be deleted from the DB and the store\n\t// if any of the subsequent steps fail.\n\tvar (\n\t\tcleanUp = false\n\t\tthumbfName = \"\"\n\t)\n\tdefer func() {\n\t\tif cleanUp {\n\t\t\ta.media.Delete(fName)\n\n\t\t\tif thumbfName != \"\" {\n\t\t\t\ta.media.Delete(thumbfName)\n\t\t\t}\n\t\t}\n\t}()\n\n\t// Thumbnail width and height.\n\tvar width, height int\n\n\t// Create thumbnail from file for non-vector formats.\n\tisImage := inArray(ext, imageExts)\n\tif isImage {\n\t\tthumbFile, wi, he, err := processImage(file)\n\t\tif err != nil {\n\t\t\tcleanUp = true\n\t\t\ta.log.Printf(\"error resizing image: %v\", err)\n\t\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\t\ta.i18n.Ts(\"media.errorResizing\", \"error\", err.Error()))\n\t\t}\n\t\twidth = wi\n\t\theight = he\n\n\t\t// Upload thumbnail.\n\t\ttf, err := a.media.Put(thumbPrefix+fName, contentType, thumbFile)\n\t\tif err != nil {\n\t\t\tcleanUp = true\n\t\t\ta.log.Printf(\"error saving thumbnail: %v\", err)\n\t\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\t\ta.i18n.Ts(\"media.errorSavingThumbnail\", \"error\", err.Error()))\n\t\t}\n\t\tthumbfName = tf\n\t}\n\tif inArray(ext, vectorExts) {\n\t\tthumbfName = fName\n\t}\n\n\t// Images have metadata.\n\tmeta := models.JSON{}\n\tif isImage {\n\t\tmeta = models.JSON{\n\t\t\t\"width\": width,\n\t\t\t\"height\": height,\n\t\t}\n\t}\n\n\t// Insert the media into the DB.\n\tm, err := a.core.InsertMedia(fName, thumbfName, contentType, meta, a.cfg.MediaUpload.Provider, a.media)\n\tif err != nil {\n\t\tcleanUp = true\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{m})\n}\n\n// GetAllMedia handles retrieval of uploaded media.\nfunc (a *App) GetAllMedia(c echo.Context) error {\n\tvar (\n\t\tquery = c.FormValue(\"query\")\n\n\t\tpg = a.pg.NewFromURL(c.Request().URL.Query())\n\t)\n\t// Fetch the media items from the DB.\n\tres, total, err := a.core.QueryMedia(a.cfg.MediaUpload.Provider, a.media, query, pg.Offset, pg.Limit)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tout := models.PageResults{\n\t\tResults: res,\n\t\tTotal: total,\n\t\tPage: pg.Page,\n\t\tPerPage: pg.PerPage,\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetMedia handles retrieval of a media item by ID.\nfunc (a *App) GetMedia(c echo.Context) error {\n\t// Fetch the media item from the DB.\n\tid := getID(c)\n\tout, err := a.core.GetMedia(id, \"\", \"\", a.media)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// DeleteMedia handles deletion of uploaded media.\nfunc (a *App) DeleteMedia(c echo.Context) error {\n\n\t// Delete the media from the DB. The query returns the filename.\n\tid := getID(c)\n\tfname, err := a.core.DeleteMedia(id)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Delete the files from the media store.\n\ta.media.Delete(fname)\n\ta.media.Delete(thumbPrefix + fname)\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// ServeS3Media serves media files stored in S3 when the public URL is a relative path.\nfunc (a *App) ServeS3Media(c echo.Context) error {\n\tkey := c.Param(\"filepath\")\n\tif key == \"\" {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, \"missing media file path\")\n\t}\n\n\tb, err := a.media.GetBlob(key)\n\tif err != nil {\n\t\ta.log.Printf(\"error fetching media from s3 %s: %v\", key, err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, \"error fetching media\")\n\t}\n\n\treturn c.Stream(http.StatusOK, http.DetectContentType(b), bytes.NewReader(b))\n}\n\n// processImage reads the image file and returns thumbnail bytes and\n// the original image's width, and height.\nfunc processImage(file *multipart.FileHeader) (*bytes.Reader, int, int, error) {\n\tsrc, err := file.Open()\n\tif err != nil {\n\t\treturn nil, 0, 0, err\n\t}\n\tdefer src.Close()\n\n\timg, err := imaging.Decode(src)\n\tif err != nil {\n\t\treturn nil, 0, 0, err\n\t}\n\n\t// Encode the image into a byte slice as PNG.\n\tvar (\n\t\tthumb = imaging.Resize(img, thumbnailSize, 0, imaging.Lanczos)\n\t\tout bytes.Buffer\n\t)\n\tif err := imaging.Encode(&out, thumb, imaging.PNG); err != nil {\n\t\treturn nil, 0, 0, err\n\t}\n\n\tb := img.Bounds().Max\n\treturn bytes.NewReader(out.Bytes()), b.X, b.Y, nil\n}\n" }, { "path": "cmd/public.go", "content": "package main\n\nimport (\n\t\"bytes\"\n\t\"database/sql\"\n\t\"fmt\"\n\t\"html/template\"\n\t\"image\"\n\t\"image/png\"\n\t\"io\"\n\t\"net/http\"\n\t\"strconv\"\n\t\"strings\"\n\n\t\"github.com/knadh/listmonk/internal/captcha\"\n\t\"github.com/knadh/listmonk/internal/i18n\"\n\t\"github.com/knadh/listmonk/internal/manager\"\n\t\"github.com/knadh/listmonk/internal/notifs\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n\t\"github.com/lib/pq\"\n)\n\nconst (\n\ttplMessage = \"message\"\n)\n\n// tplRenderer wraps a template.tplRenderer for echo.\ntype tplRenderer struct {\n\ttemplates *template.Template\n\tSiteName string\n\tRootURL string\n\tLogoURL string\n\tFaviconURL string\n\tAssetVersion string\n\tEnablePublicSubPage bool\n\tEnablePublicArchive bool\n\tIndividualTracking bool\n}\n\n// tplData is the data container that is injected\n// into public templates for accessing data.\ntype tplData struct {\n\tSiteName string\n\tRootURL string\n\tLogoURL string\n\tFaviconURL string\n\tAssetVersion string\n\tEnablePublicSubPage bool\n\tEnablePublicArchive bool\n\tIndividualTracking bool\n\tData any\n\tL *i18n.I18n\n}\n\ntype publicTpl struct {\n\tTitle string\n\tDescription string\n}\n\ntype unsubTpl struct {\n\tpublicTpl\n\tSubscriber models.Subscriber\n\tSubscriptions []models.Subscription\n\tSubUUID string\n\tAllowBlocklist bool\n\tAllowExport bool\n\tAllowWipe bool\n\tAllowPreferences bool\n\tShowManage bool\n}\n\ntype optinReq struct {\n\tSubUUID string\n\tListUUIDs []string `query:\"l\" form:\"l\"`\n\tLists []models.List `query:\"-\" form:\"-\"`\n}\n\ntype optinTpl struct {\n\tpublicTpl\n\toptinReq\n}\n\ntype msgTpl struct {\n\tpublicTpl\n\tMessageTitle string\n\tMessage string\n}\n\ntype subFormTpl struct {\n\tpublicTpl\n\tLists []models.List\n\tCaptcha struct {\n\t\tEnabled bool\n\t\tProvider string\n\t\tKey string\n\t\tComplexity int\n\t}\n}\n\nvar (\n\tpixelPNG = drawTransparentImage(3, 14)\n)\n\n// Render executes and renders a template for echo.\nfunc (t *tplRenderer) Render(w io.Writer, name string, data any, c echo.Context) error {\n\treturn t.templates.ExecuteTemplate(w, name, tplData{\n\t\tSiteName: t.SiteName,\n\t\tRootURL: t.RootURL,\n\t\tLogoURL: t.LogoURL,\n\t\tFaviconURL: t.FaviconURL,\n\t\tAssetVersion: t.AssetVersion,\n\t\tEnablePublicSubPage: t.EnablePublicSubPage,\n\t\tEnablePublicArchive: t.EnablePublicArchive,\n\t\tIndividualTracking: t.IndividualTracking,\n\t\tData: data,\n\t\tL: c.Get(\"app\").(*App).i18n,\n\t})\n}\n\n// GetPublicLists returns the list of public lists with minimal fields\n// required to submit a subscription.\nfunc (a *App) GetPublicLists(c echo.Context) error {\n\t// Get all public lists.\n\tlists, err := a.core.GetLists(models.ListTypePublic, models.ListStatusActive, true, nil)\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"public.errorFetchingLists\"))\n\t}\n\n\ttype list struct {\n\t\tUUID string `json:\"uuid\"`\n\t\tName string `json:\"name\"`\n\t}\n\n\tout := make([]list, 0, len(lists))\n\tfor _, l := range lists {\n\t\tout = append(out, list{\n\t\t\tUUID: l.UUID,\n\t\t\tName: l.Name,\n\t\t})\n\t}\n\n\treturn c.JSON(http.StatusOK, out)\n}\n\n// ViewCampaignMessage renders the HTML view of a campaign message.\n// This is the view the {{ MessageURL }} template tag links to in e-mail campaigns.\nfunc (a *App) ViewCampaignMessage(c echo.Context) error {\n\t// Get the campaign.\n\tcampUUID := c.Param(\"campUUID\")\n\tcamp, err := a.core.GetCampaign(0, campUUID, \"\")\n\tif err != nil {\n\t\tif er, ok := err.(*echo.HTTPError); ok {\n\t\t\tif er.Code == http.StatusBadRequest {\n\t\t\t\treturn c.Render(http.StatusNotFound, tplMessage,\n\t\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.notFoundTitle\"), \"\", a.i18n.T(\"public.campaignNotFound\")))\n\t\t\t}\n\t\t}\n\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\t// Get the subscriber.\n\tsubUUID := c.Param(\"subUUID\")\n\tsub, err := a.core.GetSubscriber(0, subUUID, \"\")\n\tif err != nil {\n\t\tif err == sql.ErrNoRows {\n\t\t\treturn c.Render(http.StatusNotFound, tplMessage,\n\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.notFoundTitle\"), \"\", a.i18n.T(\"public.errorFetchingEmail\")))\n\t\t}\n\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\t// Compile the template.\n\tif err := camp.CompileTemplate(a.manager.TemplateFuncs(&camp)); err != nil {\n\t\ta.log.Printf(\"error compiling template: %v\", err)\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\t// Render the message body.\n\tmsg, err := a.manager.NewCampaignMessage(&camp, sub)\n\tif err != nil {\n\t\ta.log.Printf(\"error rendering message: %v\", err)\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingCampaign\")))\n\t}\n\n\treturn c.HTML(http.StatusOK, string(msg.Body()))\n}\n\n// SubscriptionPage renders the subscription management page and handles unsubscriptions.\n// This is the view that {{ UnsubscribeURL }} in campaigns link to.\nfunc (a *App) SubscriptionPage(c echo.Context) error {\n\tvar (\n\t\tsubUUID = c.Param(\"subUUID\")\n\t\tshowManage, _ = strconv.ParseBool(c.FormValue(\"manage\"))\n\t)\n\n\t// Get the subscriber from the DB.\n\ts, err := a.core.GetSubscriber(0, subUUID, \"\")\n\tif err != nil {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorProcessingRequest\")))\n\t}\n\n\t// Prepare the public template.\n\tout := unsubTpl{\n\t\tSubscriber: s,\n\t\tSubUUID: subUUID,\n\t\tpublicTpl: publicTpl{Title: a.i18n.T(\"public.unsubscribeTitle\")},\n\t\tAllowBlocklist: a.cfg.Privacy.AllowBlocklist,\n\t\tAllowExport: a.cfg.Privacy.AllowExport,\n\t\tAllowWipe: a.cfg.Privacy.AllowWipe,\n\t\tAllowPreferences: a.cfg.Privacy.AllowPreferences,\n\t}\n\n\t// If the subscriber is blocklisted, throw an error.\n\tif s.Status == models.SubscriberStatusBlockListed {\n\t\treturn c.Render(http.StatusOK, tplMessage, makeMsgTpl(a.i18n.T(\"public.noSubTitle\"), \"\", a.i18n.Ts(\"public.blocklisted\")))\n\t}\n\n\t// Only show preference management if it's enabled in settings.\n\tif a.cfg.Privacy.AllowPreferences {\n\t\tout.ShowManage = showManage\n\n\t\t// Get the subscriber's lists from the DB to render in the template.\n\t\tsubs, err := a.core.GetSubscriptions(0, subUUID, false)\n\t\tif err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"public.errorFetchingLists\"))\n\t\t}\n\n\t\tout.Subscriptions = make([]models.Subscription, 0, len(subs))\n\t\tfor _, s := range subs {\n\t\t\t// Private lists shouldn't be rendered in the template.\n\t\t\tif s.Type == models.ListTypePrivate {\n\t\t\t\tcontinue\n\t\t\t}\n\n\t\t\tout.Subscriptions = append(out.Subscriptions, s)\n\t\t}\n\t}\n\n\treturn c.Render(http.StatusOK, \"subscription\", out)\n}\n\n// SubscriptionPrefs renders the subscription management page and\n// s unsubscriptions. This is the view that {{ UnsubscribeURL }} in\n// campaigns link to.\nfunc (a *App) SubscriptionPrefs(c echo.Context) error {\n\t// Read the form.\n\tvar req struct {\n\t\tName string `form:\"name\" json:\"name\"`\n\t\tListUUIDs []string `form:\"l\" json:\"list_uuids\"`\n\t\tBlocklist bool `form:\"blocklist\" json:\"blocklist\"`\n\t\tManage bool `form:\"manage\" json:\"manage\"`\n\t}\n\tif err := c.Bind(&req); err != nil {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"globals.messages.invalidData\")))\n\t}\n\n\t// Simple unsubscribe.\n\tvar (\n\t\tcampUUID = c.Param(\"campUUID\")\n\t\tsubUUID = c.Param(\"subUUID\")\n\t\tblocklist = a.cfg.Privacy.AllowBlocklist && req.Blocklist\n\t)\n\tif !req.Manage || blocklist {\n\t\tif err := a.core.UnsubscribeByCampaign(subUUID, campUUID, blocklist); err != nil {\n\t\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"public.errorProcessingRequest\")))\n\t\t}\n\n\t\treturn c.Render(http.StatusOK, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.unsubbedTitle\"), \"\", a.i18n.T(\"public.unsubbedInfo\")))\n\t}\n\n\t// Is preference management enabled?\n\tif !a.cfg.Privacy.AllowPreferences {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"public.invalidFeature\")))\n\t}\n\n\t// Manage preferences.\n\treq.Name = strings.TrimSpace(req.Name)\n\tif req.Name == \"\" || len(req.Name) > 256 {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"subscribers.invalidName\")))\n\t}\n\n\t// Get the subscriber from the DB.\n\tsub, err := a.core.GetSubscriber(0, subUUID, \"\")\n\tif err != nil {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"globals.messages.pFound\",\n\t\t\t\t\"name\", a.i18n.T(\"globals.terms.subscriber\"))))\n\t}\n\tsub.Name = req.Name\n\n\t// Update the subscriber properties in the DB.\n\tif _, err := a.core.UpdateSubscriber(sub.ID, sub); err != nil {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"public.errorProcessingRequest\")))\n\t}\n\n\t// Get the subscriber's lists and whatever is not sent in the request (unchecked),\n\t// unsubscribe them.\n\treqUUIDs := make(map[string]struct{})\n\tfor _, u := range req.ListUUIDs {\n\t\treqUUIDs[u] = struct{}{}\n\t}\n\n\t// Get subscription from teh DB.\n\tsubs, err := a.core.GetSubscriptions(0, subUUID, false)\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"public.errorFetchingLists\"))\n\t}\n\n\t// Filter the lists in the request against the subscriptions in the DB.\n\tunsubUUIDs := make([]string, 0, len(req.ListUUIDs))\n\tfor _, s := range subs {\n\t\tif s.Type == models.ListTypePrivate {\n\t\t\tcontinue\n\t\t}\n\t\tif _, ok := reqUUIDs[s.UUID]; !ok {\n\t\t\tunsubUUIDs = append(unsubUUIDs, s.UUID)\n\t\t}\n\t}\n\n\t// Unsubscribe from lists.\n\tif err := a.core.UnsubscribeLists([]int{sub.ID}, nil, unsubUUIDs); err != nil {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"public.errorProcessingRequest\")))\n\n\t}\n\n\treturn c.Render(http.StatusOK, tplMessage,\n\t\tmakeMsgTpl(a.i18n.T(\"globals.messages.done\"), \"\", a.i18n.T(\"public.prefsSaved\")))\n}\n\n// OptinPage renders the double opt-in confirmation page that subscribers\n// see when they click on the \"Confirm subscription\" button in double-optin\n// notifications.\nfunc (a *App) OptinPage(c echo.Context) error {\n\tvar (\n\t\tsubUUID = c.Param(\"subUUID\")\n\t\tconfirm, _ = strconv.ParseBool(c.FormValue(\"confirm\"))\n\t\treq optinReq\n\t)\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\n\t// Validate list UUIDs if there are incoming UUIDs in the request.\n\tif len(req.ListUUIDs) > 0 {\n\t\tfor _, l := range req.ListUUIDs {\n\t\t\tif !reUUID.MatchString(l) {\n\t\t\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"globals.messages.invalidUUID\")))\n\t\t\t}\n\t\t}\n\t}\n\n\t// Get the list of subscription lists where the subscriber hasn't confirmed.\n\tlists, err := a.core.GetSubscriberLists(0, subUUID, nil, req.ListUUIDs, models.SubscriptionStatusUnconfirmed, \"\")\n\tif err != nil {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingLists\")))\n\t}\n\n\t// There are no lists to confirm.\n\tif len(lists) == 0 {\n\t\treturn c.Render(http.StatusOK, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.noSubTitle\"), \"\", a.i18n.Ts(\"public.noSubInfo\")))\n\t}\n\n\t// Confirm.\n\tif confirm {\n\t\tmeta := models.JSON{}\n\t\tif a.cfg.Privacy.RecordOptinIP {\n\t\t\tif h := c.Request().Header.Get(\"X-Forwarded-For\"); h != \"\" {\n\t\t\t\tmeta[\"optin_ip\"] = h\n\t\t\t} else if h := c.Request().RemoteAddr; h != \"\" {\n\t\t\t\tmeta[\"optin_ip\"] = strings.Split(h, \":\")[0]\n\t\t\t}\n\t\t}\n\n\t\t// Confirm subscriptions in the DB.\n\t\tif err := a.core.ConfirmOptionSubscription(subUUID, req.ListUUIDs, meta); err != nil {\n\t\t\ta.log.Printf(\"error unsubscribing: %v\", err)\n\t\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorProcessingRequest\")))\n\t\t}\n\n\t\treturn c.Render(http.StatusOK, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.subConfirmedTitle\"), \"\", a.i18n.Ts(\"public.subConfirmed\")))\n\t}\n\n\tvar out optinTpl\n\tout.Lists = lists\n\tout.SubUUID = subUUID\n\tout.Title = a.i18n.T(\"public.confirmOptinSubTitle\")\n\n\treturn c.Render(http.StatusOK, \"optin\", out)\n}\n\n// SubscriptionFormPage handles subscription requests coming from public\n// HTML subscription forms.\nfunc (a *App) SubscriptionFormPage(c echo.Context) error {\n\tif !a.cfg.EnablePublicSubPage {\n\t\treturn c.Render(http.StatusNotFound, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.invalidFeature\")))\n\t}\n\n\t// Get all public lists from the DB.\n\tlists, err := a.core.GetLists(models.ListTypePublic, models.ListStatusActive, true, nil)\n\tif err != nil {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorFetchingLists\")))\n\t}\n\n\t// There are no public lists available for subscription.\n\tif len(lists) == 0 {\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.noListsAvailable\")))\n\t}\n\n\tout := subFormTpl{}\n\tout.Title = a.i18n.T(\"public.sub\")\n\tout.Lists = lists\n\n\t// Captcha configuration for template rendering.\n\tif a.cfg.Security.Captcha.Altcha.Enabled {\n\t\tout.Captcha.Enabled = true\n\t\tout.Captcha.Provider = \"altcha\"\n\t\tout.Captcha.Complexity = a.cfg.Security.Captcha.Altcha.Complexity\n\t} else if a.cfg.Security.Captcha.HCaptcha.Enabled {\n\t\tout.Captcha.Enabled = true\n\t\tout.Captcha.Provider = \"hcaptcha\"\n\t\tout.Captcha.Key = a.cfg.Security.Captcha.HCaptcha.Key\n\t}\n\n\treturn c.Render(http.StatusOK, \"subscription-form\", out)\n}\n\n// SubscriptionForm handles subscription requests coming from public\n// HTML subscription forms.\nfunc (a *App) SubscriptionForm(c echo.Context) error {\n\tif !a.cfg.EnablePublicSubPage {\n\t\treturn echo.NewHTTPError(http.StatusNotFound, a.i18n.T(\"public.invalidFeature\"))\n\n\t}\n\n\t// If there's a nonce value, a bot could've filled the form.\n\tif c.FormValue(\"nonce\") != \"\" {\n\t\treturn echo.NewHTTPError(http.StatusBadGateway, a.i18n.T(\"public.invalidFeature\"))\n\t}\n\n\t// Process CAPTCHA.\n\tif a.captcha.IsEnabled() {\n\t\tvar val string\n\n\t\t// Get the appropriate captcha response field based on provider.\n\t\tswitch a.captcha.GetProvider() {\n\t\tcase captcha.ProviderHCaptcha:\n\t\t\tval = c.FormValue(\"h-captcha-response\")\n\t\tcase captcha.ProviderAltcha:\n\t\t\tval = c.FormValue(\"altcha\")\n\t\tdefault:\n\t\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"public.invalidCaptcha\")))\n\t\t}\n\n\t\tif val == \"\" {\n\t\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"public.invalidCaptcha\")))\n\t\t}\n\n\t\terr, ok := a.captcha.Verify(val)\n\t\tif err != nil {\n\t\t\ta.log.Printf(\"captcha request failed: %v\", err)\n\t\t}\n\n\t\tif !ok {\n\t\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.T(\"public.invalidCaptcha\")))\n\t\t}\n\t}\n\n\thasOptin, err := a.processSubForm(c)\n\tif err != nil {\n\t\te, ok := err.(*echo.HTTPError)\n\t\tif !ok {\n\t\t\treturn err\n\t\t}\n\n\t\treturn c.Render(e.Code, tplMessage, makeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", fmt.Sprintf(\"%s\", e.Message)))\n\t}\n\n\t// If there were double optin lists, show the opt-in pending message instead of\n\t// the subscription confirmation message.\n\tmsg := \"public.subConfirmed\"\n\tif hasOptin {\n\t\tmsg = \"public.subOptinPending\"\n\t}\n\n\treturn c.Render(http.StatusOK, tplMessage, makeMsgTpl(a.i18n.T(\"public.subTitle\"), \"\", a.i18n.Ts(msg)))\n}\n\n// PublicSubscription handles subscription requests coming from public\n// API calls.\nfunc (a *App) PublicSubscription(c echo.Context) error {\n\tif !a.cfg.EnablePublicSubPage {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"public.invalidFeature\"))\n\t}\n\n\thasOptin, err := a.processSubForm(c)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{struct {\n\t\tHasOptin bool `json:\"has_optin\"`\n\t}{hasOptin}})\n}\n\n// LinkRedirect redirects a link UUID to its original underlying link\n// after recording the link click for a particular subscriber in the particular\n// campaign. These links are generated by {{ TrackLink }} tags in campaigns.\nfunc (a *App) LinkRedirect(c echo.Context) error {\n\tvar (\n\t\tlinkUUID = c.Param(\"linkUUID\")\n\t\tcampUUID = c.Param(\"campUUID\")\n\t)\n\n\t// If tracking is globally disabled, resolve the URL without recording a click.\n\tif a.cfg.Privacy.DisableTracking {\n\t\turl, err := a.core.GetLinkURL(linkUUID)\n\t\tif err != nil {\n\t\t\te := err.(*echo.HTTPError)\n\t\t\treturn c.Render(e.Code, tplMessage, makeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", e.Error()))\n\t\t}\n\t\treturn c.Redirect(http.StatusTemporaryRedirect, url)\n\t}\n\n\t// If individual tracking is disabled, do not record the subscriber ID.\n\tsubUUID := c.Param(\"subUUID\")\n\tif !a.cfg.Privacy.IndividualTracking {\n\t\tsubUUID = \"\"\n\t}\n\n\turl, err := a.core.RegisterCampaignLinkClick(linkUUID, campUUID, subUUID)\n\tif err != nil {\n\t\te := err.(*echo.HTTPError)\n\t\treturn c.Render(e.Code, tplMessage, makeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", e.Error()))\n\t}\n\n\treturn c.Redirect(http.StatusTemporaryRedirect, url)\n}\n\n// RegisterCampaignView registers a campaign view which comes in\n// the form of an pixel image request. Regardless of errors, this handler\n// should always render the pixel image bytes. The pixel URL is generated by\n// the {{ TrackView }} template tag in campaigns.\nfunc (a *App) RegisterCampaignView(c echo.Context) error {\n\t// If tracking is globally disabled, return the pixel without recording.\n\tif a.cfg.Privacy.DisableTracking {\n\t\tc.Response().Header().Set(\"Cache-Control\", \"no-cache\")\n\t\treturn c.Blob(http.StatusOK, \"image/png\", pixelPNG)\n\t}\n\n\t// If individual tracking is disabled, do not record the subscriber ID.\n\tsubUUID := c.Param(\"subUUID\")\n\tif !a.cfg.Privacy.IndividualTracking {\n\t\tsubUUID = \"\"\n\t}\n\n\t// Exclude dummy hits from template previews.\n\tcampUUID := c.Param(\"campUUID\")\n\tif campUUID != dummyUUID && subUUID != dummyUUID {\n\t\tif err := a.core.RegisterCampaignView(campUUID, subUUID); err != nil {\n\t\t\ta.log.Printf(\"error registering campaign view: %s\", err)\n\t\t}\n\t}\n\n\tc.Response().Header().Set(\"Cache-Control\", \"no-cache\")\n\treturn c.Blob(http.StatusOK, \"image/png\", pixelPNG)\n}\n\n// SelfExportSubscriberData pulls the subscriber's profile, list subscriptions,\n// campaign views and clicks and produces a JSON report that is then e-mailed\n// to the subscriber. This is a privacy feature and the data that's exported\n// is dependent on the configuration.\nfunc (a *App) SelfExportSubscriberData(c echo.Context) error {\n\t// Is export allowed?\n\tif !a.cfg.Privacy.AllowExport {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.invalidFeature\")))\n\t}\n\n\t// Get the subscriber's data. A single query that gets the profile,\n\t// list subscriptions, campaign views, and link clicks. Names of\n\t// private lists are replaced with \"Private list\".\n\tsubUUID := c.Param(\"subUUID\")\n\tdata, b, err := a.exportSubscriberData(0, subUUID, a.cfg.Privacy.Exportable)\n\tif err != nil {\n\t\ta.log.Printf(\"error exporting subscriber data: %s\", err)\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorProcessingRequest\")))\n\t}\n\n\t// Prepare the attachment e-mail.\n\tvar msg bytes.Buffer\n\tif err := notifs.Tpls.ExecuteTemplate(&msg, notifs.TplSubscriberData, data); err != nil {\n\t\ta.log.Printf(\"error compiling notification template '%s': %v\", notifs.TplSubscriberData, err)\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorProcessingRequest\")))\n\t}\n\n\t// TODO: GetTplSubject should be moved to a utils package.\n\tsubject, body := notifs.GetTplSubject(a.i18n.Ts(\"email.data.title\"), msg.Bytes())\n\n\t// E-mail the data as a JSON attachment to the subscriber.\n\tconst fname = \"data.json\"\n\tif err := a.emailMsgr.Push(models.Message{\n\t\tFrom: a.cfg.FromEmail,\n\t\tTo: []string{data.Email},\n\t\tSubject: subject,\n\t\tBody: body,\n\t\tAttachments: []models.Attachment{\n\t\t\t{\n\t\t\t\tName: fname,\n\t\t\t\tContent: b,\n\t\t\t\tHeader: manager.MakeAttachmentHeader(fname, \"base64\", \"application/json\"),\n\t\t\t},\n\t\t},\n\t}); err != nil {\n\t\ta.log.Printf(\"error e-mailing subscriber profile: %s\", err)\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorProcessingRequest\")))\n\t}\n\n\treturn c.Render(http.StatusOK, tplMessage,\n\t\tmakeMsgTpl(a.i18n.T(\"public.dataSentTitle\"), \"\", a.i18n.T(\"public.dataSent\")))\n}\n\n// WipeSubscriberData allows a subscriber to delete their data. The\n// profile and subscriptions are deleted, while the campaign_views and link\n// clicks remain as orphan data unconnected to any subscriber.\nfunc (a *App) WipeSubscriberData(c echo.Context) error {\n\t// Is wiping allowed?\n\tif !a.cfg.Privacy.AllowWipe {\n\t\treturn c.Render(http.StatusBadRequest, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.invalidFeature\")))\n\t}\n\n\tsubUUID := c.Param(\"subUUID\")\n\tif err := a.core.DeleteSubscribers(nil, []string{subUUID}); err != nil {\n\t\ta.log.Printf(\"error wiping subscriber data: %s\", err)\n\t\treturn c.Render(http.StatusInternalServerError, tplMessage,\n\t\t\tmakeMsgTpl(a.i18n.T(\"public.errorTitle\"), \"\", a.i18n.Ts(\"public.errorProcessingRequest\")))\n\t}\n\n\treturn c.Render(http.StatusOK, tplMessage,\n\t\tmakeMsgTpl(a.i18n.T(\"public.dataRemovedTitle\"), \"\", a.i18n.T(\"public.dataRemoved\")))\n}\n\n// AltchaChallenge generates a challenge for Altcha captcha.\nfunc (a *App) AltchaChallenge(c echo.Context) error {\n\t// Check if Altcha is enabled.\n\tif !a.captcha.IsEnabled() || a.captcha.GetProvider() != captcha.ProviderAltcha {\n\t\treturn echo.NewHTTPError(http.StatusNotFound, \"captcha not enabled\")\n\t}\n\n\t// Generate challenge.\n\tout, err := a.captcha.GenerateChallenge()\n\tif err != nil {\n\t\ta.log.Printf(\"error generating altcha challenge: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, \"Error generating challenge\")\n\t}\n\n\t// Return the challenge as JSON.\n\tc.Response().Header().Set(\"Content-Type\", \"application/json\")\n\treturn c.String(http.StatusOK, out)\n}\n\n// drawTransparentImage draws a transparent PNG of given dimensions\n// and returns the PNG bytes.\nfunc drawTransparentImage(h, w int) []byte {\n\tvar (\n\t\timg = image.NewRGBA(image.Rect(0, 0, w, h))\n\t\tout = &bytes.Buffer{}\n\t)\n\t_ = png.Encode(out, img)\n\n\treturn out.Bytes()\n}\n\n// processSubForm processes an incoming form/public API subscription request.\n// The bool indicates whether there was subscription to an optin list so that\n// an appropriate message can be shown.\nfunc (a *App) processSubForm(c echo.Context) (bool, error) {\n\t// Get and validate fields.\n\tvar req struct {\n\t\tName string `form:\"name\" json:\"name\"`\n\t\tEmail string `form:\"email\" json:\"email\"`\n\t\tFormListUUIDs []string `form:\"l\" json:\"list_uuids\"`\n\t}\n\tif err := c.Bind(&req); err != nil {\n\t\treturn false, err\n\t}\n\n\tif len(req.FormListUUIDs) == 0 {\n\t\treturn false, echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"public.noListsSelected\"))\n\t}\n\n\t// Validate fields.\n\tif len(req.Email) > 1000 {\n\t\treturn false, echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"subscribers.invalidEmail\"))\n\t}\n\n\tem, err := a.importer.SanitizeEmail(req.Email)\n\tif err != nil {\n\t\treturn false, echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t}\n\treq.Email = em\n\n\treq.Name = strings.TrimSpace(req.Name)\n\tif len(req.Name) == 0 {\n\t\t// If there's no name, use the name bit from the e-mail.\n\t\treq.Name = strings.Split(req.Email, \"@\")[0]\n\t} else if len(req.Name) > stdInputMaxLen {\n\t\treturn false, echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"subscribers.invalidName\"))\n\t}\n\n\tlistUUIDs := pq.StringArray(req.FormListUUIDs)\n\n\t// Fetch the list types and ensure that they are not private.\n\tlistTypes, err := a.core.GetListTypes(nil, req.FormListUUIDs)\n\tif err != nil {\n\t\treturn false, echo.NewHTTPError(http.StatusInternalServerError, fmt.Sprintf(\"%s\", err.(*echo.HTTPError).Message))\n\t}\n\n\tfor _, t := range listTypes {\n\t\tif t == models.ListTypePrivate {\n\t\t\treturn false, echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidUUID\"))\n\t\t}\n\t}\n\n\t// Insert the subscriber into the DB.\n\t_, hasOptin, err := a.core.InsertSubscriber(models.Subscriber{\n\t\tName: req.Name,\n\t\tEmail: req.Email,\n\t\tStatus: models.SubscriberStatusEnabled,\n\t}, nil, listUUIDs, false, true)\n\tif err == nil {\n\t\treturn hasOptin, nil\n\t}\n\n\t// Insert returned an error. Examine it.\n\tvar lastErr = err\n\n\t// Subscriber already exists. Update subscriptions in the DB.\n\tif e, ok := err.(*echo.HTTPError); ok && e.Code == http.StatusConflict {\n\t\t// Get the subscriber from the DB by their email.\n\t\tsub, err := a.core.GetSubscriber(0, \"\", req.Email)\n\t\tif err != nil {\n\t\t\treturn false, err\n\t\t}\n\n\t\t// Update the subscriber's subscriptions in the DB.\n\t\t_, hasOptin, err := a.core.UpdateSubscriberWithLists(sub.ID, sub, nil, listUUIDs, false, false, true, nil)\n\t\tif err == nil {\n\t\t\treturn hasOptin, nil\n\t\t}\n\t\tlastErr = err\n\t}\n\n\t// Something else went wrong.\n\tif e, ok := lastErr.(*echo.HTTPError); ok {\n\t\treturn false, echo.NewHTTPError(http.StatusBadRequest, fmt.Sprintf(\"%s\", e.Message))\n\t}\n\treturn false, echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"public.errorProcessingRequest\"))\n}\n" }, { "path": "cmd/roles.go", "content": "package main\n\nimport (\n\t\"fmt\"\n\t\"net/http\"\n\t\"strings\"\n\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/labstack/echo/v4\"\n)\n\n// GetUserRoles retrieves roles.\nfunc (a *App) GetUserRoles(c echo.Context) error {\n\t// Get all roles.\n\tout, err := a.core.GetRoles()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GeListRoles retrieves roles.\nfunc (a *App) GeListRoles(c echo.Context) error {\n\t// Get all roles.\n\tout, err := a.core.GetListRoles()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// CreateUserRole handles role creation.\nfunc (a *App) CreateUserRole(c echo.Context) error {\n\tvar r auth.Role\n\tif err := c.Bind(&r); err != nil {\n\t\treturn err\n\t}\n\tif err := a.validateUserRole(r); err != nil {\n\t\treturn err\n\t}\n\n\t// Create the role in the DB.\n\tout, err := a.core.CreateRole(r)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// CreateListRole handles role creation.\nfunc (a *App) CreateListRole(c echo.Context) error {\n\tvar r auth.ListRole\n\tif err := c.Bind(&r); err != nil {\n\t\treturn err\n\t}\n\tif err := a.validateListRole(r); err != nil {\n\t\treturn err\n\t}\n\n\t// Create the role in the DB.\n\tout, err := a.core.CreateListRole(r)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// UpdateUserRole handles role modification.\nfunc (a *App) UpdateUserRole(c echo.Context) error {\n\tid := getID(c)\n\n\t// ID 1 is reserved for the Super Admin user role.\n\tif id == auth.SuperAdminRoleID {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidID\"))\n\t}\n\n\t// Incoming params.\n\tvar r auth.Role\n\tif err := c.Bind(&r); err != nil {\n\t\treturn err\n\t}\n\tif err := a.validateUserRole(r); err != nil {\n\t\treturn err\n\t}\n\n\t// Validate.\n\tr.Name.String = strings.TrimSpace(r.Name.String)\n\n\t// Update the role in the DB.\n\tout, err := a.core.UpdateUserRole(id, r)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Cache API tokens for in-memory, off-DB /api/* request auth.\n\tif _, err := cacheUsers(a.core, a.auth); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// UpdateListRole handles role modification.\nfunc (a *App) UpdateListRole(c echo.Context) error {\n\t// Get the role ID.\n\tid := getID(c)\n\n\t// ID 1 is reserved for the Super Admin user role.\n\tif id == auth.SuperAdminRoleID {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidID\"))\n\t}\n\n\t// Incoming params.\n\tvar r auth.ListRole\n\tif err := c.Bind(&r); err != nil {\n\t\treturn err\n\t}\n\n\tif err := a.validateListRole(r); err != nil {\n\t\treturn err\n\t}\n\n\t// Validate.\n\tr.Name.String = strings.TrimSpace(r.Name.String)\n\n\t// Update the role in the DB.\n\tout, err := a.core.UpdateListRole(id, r)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Cache API tokens for in-memory, off-DB /api/* request auth.\n\tif _, err := cacheUsers(a.core, a.auth); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// DeleteRole handles (user|list) role deletion.\nfunc (a *App) DeleteRole(c echo.Context) error {\n\t// Get the role ID.\n\tid := getID(c)\n\n\t// ID 1 is reserved for the Super Admin user role.\n\tif id == auth.SuperAdminRoleID {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidID\"))\n\t}\n\n\t// Delete the role from the DB.\n\tif err := a.core.DeleteRole(int(id)); err != nil {\n\t\treturn err\n\t}\n\n\t// Cache API tokens for in-memory, off-DB /api/* request auth.\n\tif _, err := cacheUsers(a.core, a.auth); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\nfunc (a *App) validateUserRole(r auth.Role) error {\n\tif !strHasLen(r.Name.String, 1, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"name\"))\n\t}\n\n\tfor _, p := range r.Permissions {\n\t\tif _, ok := a.cfg.Permissions[p]; !ok {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", fmt.Sprintf(\"permission: %s\", p)))\n\t\t}\n\t}\n\n\treturn nil\n}\n\nfunc (a *App) validateListRole(r auth.ListRole) error {\n\tif !strHasLen(r.Name.String, 1, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"name\"))\n\t}\n\n\tfor _, l := range r.Lists {\n\t\tfor _, p := range l.Permissions {\n\t\t\tif p != auth.PermListGet && p != auth.PermListManage {\n\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", fmt.Sprintf(\"list permission: %s\", p)))\n\t\t\t}\n\t\t}\n\t}\n\n\treturn nil\n}\n" }, { "path": "cmd/settings.go", "content": "package main\n\nimport (\n\t\"bytes\"\n\t\"encoding/json\"\n\t\"io\"\n\t\"net/http\"\n\t\"net/url\"\n\t\"regexp\"\n\t\"runtime\"\n\t\"strings\"\n\t\"syscall\"\n\t\"time\"\n\t\"unicode/utf8\"\n\n\t\"github.com/gdgvda/cron\"\n\t\"github.com/gofrs/uuid/v5\"\n\t\"github.com/jmoiron/sqlx/types\"\n\tkoanfjson \"github.com/knadh/koanf/parsers/json\"\n\t\"github.com/knadh/koanf/providers/rawbytes\"\n\t\"github.com/knadh/koanf/v2\"\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/internal/messenger/email\"\n\t\"github.com/knadh/listmonk/internal/notifs\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n)\n\nconst pwdMask = \"•\"\n\ntype aboutHost struct {\n\tOS string `json:\"os\"`\n\tMachine string `json:\"arch\"`\n\tHostname string `json:\"hostname\"`\n}\n\ntype aboutSystem struct {\n\tNumCPU int `json:\"num_cpu\"`\n\tAllocMB uint64 `json:\"memory_alloc_mb\"`\n\tOSMB uint64 `json:\"memory_from_os_mb\"`\n}\n\ntype about struct {\n\tVersion string `json:\"version\"`\n\tBuild string `json:\"build\"`\n\tGoVersion string `json:\"go_version\"`\n\tGoArch string `json:\"go_arch\"`\n\tDatabase types.JSONText `json:\"database\"`\n\tSystem aboutSystem `json:\"system\"`\n\tHost aboutHost `json:\"host\"`\n}\n\nvar (\n\treAlphaNum = regexp.MustCompile(`[^a-z0-9\\-]`)\n)\n\n// GetSettings returns settings from the DB.\nfunc (a *App) GetSettings(c echo.Context) error {\n\ts, err := a.core.GetSettings()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Empty out passwords.\n\tfor i := range s.SMTP {\n\t\ts.SMTP[i].Password = strings.Repeat(pwdMask, utf8.RuneCountInString(s.SMTP[i].Password))\n\t}\n\tfor i := range s.BounceBoxes {\n\t\ts.BounceBoxes[i].Password = strings.Repeat(pwdMask, utf8.RuneCountInString(s.BounceBoxes[i].Password))\n\t}\n\tfor i := range s.Messengers {\n\t\ts.Messengers[i].Password = strings.Repeat(pwdMask, utf8.RuneCountInString(s.Messengers[i].Password))\n\t}\n\n\ts.UploadS3AwsSecretAccessKey = strings.Repeat(pwdMask, utf8.RuneCountInString(s.UploadS3AwsSecretAccessKey))\n\ts.SendgridKey = strings.Repeat(pwdMask, utf8.RuneCountInString(s.SendgridKey))\n\ts.BouncePostmark.Password = strings.Repeat(pwdMask, utf8.RuneCountInString(s.BouncePostmark.Password))\n\ts.BounceForwardEmail.Key = strings.Repeat(pwdMask, utf8.RuneCountInString(s.BounceForwardEmail.Key))\n\ts.SecurityCaptcha.HCaptcha.Secret = strings.Repeat(pwdMask, utf8.RuneCountInString(s.SecurityCaptcha.HCaptcha.Secret))\n\ts.OIDC.ClientSecret = strings.Repeat(pwdMask, utf8.RuneCountInString(s.OIDC.ClientSecret))\n\n\treturn c.JSON(http.StatusOK, okResp{s})\n}\n\n// UpdateSettings returns settings from the DB.\nfunc (a *App) UpdateSettings(c echo.Context) error {\n\t// Unmarshal and marshal the fields once to sanitize the settings blob.\n\tvar set models.Settings\n\tif err := c.Bind(&set); err != nil {\n\t\treturn err\n\t}\n\n\t// Get the existing settings.\n\tcur, err := a.core.GetSettings()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Validate and sanitize postback Messenger names along with SMTP names\n\t// (where each SMTP is also considered as a standalone messenger).\n\t// Duplicates are disallowed and \"email\" is a reserved name.\n\tnames := map[string]bool{emailMsgr: true}\n\n\t// There should be at least one SMTP block that's enabled.\n\thas := false\n\tfor i, s := range set.SMTP {\n\t\tif s.Enabled {\n\t\t\thas = true\n\t\t}\n\n\t\t// Sanitize and normalize the SMTP server name.\n\t\tname := reAlphaNum.ReplaceAllString(strings.ToLower(strings.TrimSpace(s.Name)), \"-\")\n\t\tif name != \"\" {\n\t\t\tif !strings.HasPrefix(name, \"email-\") {\n\t\t\t\tname = \"email-\" + name\n\t\t\t}\n\n\t\t\tif _, ok := names[name]; ok {\n\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\t\ta.i18n.Ts(\"settings.duplicateMessengerName\", \"name\", name))\n\t\t\t}\n\n\t\t\tnames[name] = true\n\t\t}\n\t\tset.SMTP[i].Name = name\n\n\t\t// Assign a UUID. The frontend only sends a password when the user explicitly\n\t\t// changes the password. In other cases, the existing password in the DB\n\t\t// is copied while updating the settings and the UUID is used to match\n\t\t// the incoming array of SMTP blocks with the array in the DB.\n\t\tif s.UUID == \"\" {\n\t\t\tset.SMTP[i].UUID = uuid.Must(uuid.NewV4()).String()\n\t\t}\n\n\t\t// Ensure the HOST is trimmed of any whitespace.\n\t\t// This is a common mistake when copy-pasting SMTP settings.\n\t\tset.SMTP[i].Host = strings.TrimSpace(s.Host)\n\n\t\t// If there's no password coming in from the frontend, copy the existing\n\t\t// password by matching the UUID.\n\t\tif s.Password == \"\" {\n\t\t\tfor _, c := range cur.SMTP {\n\t\t\t\tif s.UUID == c.UUID {\n\t\t\t\t\tset.SMTP[i].Password = c.Password\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\t}\n\tif !has {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"settings.errorNoSMTP\"))\n\t}\n\n\t// Always remove the trailing slash from the app root URL.\n\tset.AppRootURL = strings.TrimRight(set.AppRootURL, \"/\")\n\n\t// Bounce boxes.\n\tfor i, s := range set.BounceBoxes {\n\t\t// Assign a UUID. The frontend only sends a password when the user explicitly\n\t\t// changes the password. In other cases, the existing password in the DB\n\t\t// is copied while updating the settings and the UUID is used to match\n\t\t// the incoming array of blocks with the array in the DB.\n\t\tif s.UUID == \"\" {\n\t\t\tset.BounceBoxes[i].UUID = uuid.Must(uuid.NewV4()).String()\n\t\t}\n\n\t\t// Ensure the HOST is trimmed of any whitespace.\n\t\t// This is a common mistake when copy-pasting SMTP settings.\n\t\tset.BounceBoxes[i].Host = strings.TrimSpace(s.Host)\n\n\t\tif d, _ := time.ParseDuration(s.ScanInterval); d.Minutes() < 1 {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"settings.bounces.invalidScanInterval\"))\n\t\t}\n\n\t\t// If there's no password coming in from the frontend, copy the existing\n\t\t// password by matching the UUID.\n\t\tif s.Password == \"\" {\n\t\t\tfor _, c := range cur.BounceBoxes {\n\t\t\t\tif s.UUID == c.UUID {\n\t\t\t\t\tset.BounceBoxes[i].Password = c.Password\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\t}\n\n\tfor i, m := range set.Messengers {\n\t\t// UUID to keep track of password changes similar to the SMTP logic above.\n\t\tif m.UUID == \"\" {\n\t\t\tset.Messengers[i].UUID = uuid.Must(uuid.NewV4()).String()\n\t\t}\n\n\t\tif m.Password == \"\" {\n\t\t\tfor _, c := range cur.Messengers {\n\t\t\t\tif m.UUID == c.UUID {\n\t\t\t\t\tset.Messengers[i].Password = c.Password\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\n\t\tname := reAlphaNum.ReplaceAllString(strings.ToLower(m.Name), \"\")\n\t\tif _, ok := names[name]; ok {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"settings.duplicateMessengerName\", \"name\", name))\n\t\t}\n\t\tif len(name) == 0 {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"settings.invalidMessengerName\"))\n\t\t}\n\n\t\tset.Messengers[i].Name = name\n\t\tnames[name] = true\n\t}\n\n\t// S3 password?\n\tif set.UploadS3AwsSecretAccessKey == \"\" {\n\t\tset.UploadS3AwsSecretAccessKey = cur.UploadS3AwsSecretAccessKey\n\t}\n\tif set.SendgridKey == \"\" {\n\t\tset.SendgridKey = cur.SendgridKey\n\t}\n\tif set.BouncePostmark.Password == \"\" {\n\t\tset.BouncePostmark.Password = cur.BouncePostmark.Password\n\t}\n\tif set.BounceForwardEmail.Key == \"\" {\n\t\tset.BounceForwardEmail.Key = cur.BounceForwardEmail.Key\n\t}\n\tif set.SecurityCaptcha.HCaptcha.Secret == \"\" {\n\t\tset.SecurityCaptcha.HCaptcha.Secret = cur.SecurityCaptcha.HCaptcha.Secret\n\t}\n\tif set.OIDC.ClientSecret == \"\" {\n\t\tset.OIDC.ClientSecret = cur.OIDC.ClientSecret\n\t}\n\n\t// OIDC user auto-creation is enabled. Validate.\n\tif set.OIDC.AutoCreateUsers {\n\t\tif set.OIDC.DefaultUserRoleID.Int < auth.SuperAdminRoleID {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", a.i18n.T(\"settings.security.OIDCDefaultRole\")))\n\t\t}\n\t}\n\n\tfor n, v := range set.UploadExtensions {\n\t\tset.UploadExtensions[n] = strings.ToLower(strings.TrimPrefix(strings.TrimSpace(v), \".\"))\n\t}\n\n\t// Domain blocklist / allowlist.\n\tdoms := make([]string, 0, len(set.DomainBlocklist))\n\tfor _, d := range set.DomainBlocklist {\n\t\tif d = strings.TrimSpace(strings.ToLower(d)); d != \"\" {\n\t\t\tdoms = append(doms, d)\n\t\t}\n\t}\n\tset.DomainBlocklist = doms\n\n\tdoms = make([]string, 0, len(set.DomainAllowlist))\n\tfor _, d := range set.DomainAllowlist {\n\t\tif d = strings.TrimSpace(strings.ToLower(d)); d != \"\" {\n\t\t\tdoms = append(doms, d)\n\t\t}\n\t}\n\tset.DomainAllowlist = doms\n\n\t// Validate and clean CORS domains.\n\tcors := make([]string, 0, len(set.SecurityCORSOrigins))\n\tfor _, d := range set.SecurityCORSOrigins {\n\t\tif d = strings.TrimSpace(d); d != \"\" {\n\t\t\tif d == \"*\" {\n\t\t\t\tcors = append(cors, d)\n\t\t\t\tcontinue\n\t\t\t}\n\n\t\t\t// Parse and validate the URL.\n\t\t\tu, err := url.Parse(d)\n\t\t\tif err != nil || (u.Scheme != \"http\" && u.Scheme != \"https\") || u.Host == \"\" {\n\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\t\ta.i18n.Ts(\"globals.messages.invalidData\")+\": invalid CORS domain: \"+d)\n\t\t\t}\n\t\t\t// Save clean scheme + host\n\t\t\tcors = append(cors, u.Scheme+\"://\"+u.Host)\n\t\t}\n\t}\n\tset.SecurityCORSOrigins = cors\n\n\t// Validate slow query caching cron.\n\tif set.CacheSlowQueries {\n\t\tif _, err := cron.ParseStandard(set.CacheSlowQueriesInterval); err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidData\")+\": slow query cron: \"+err.Error())\n\t\t}\n\t}\n\n\t// Update the settings in the DB.\n\tif err := a.core.UpdateSettings(set); err != nil {\n\t\treturn err\n\t}\n\n\treturn a.handleSettingsRestart(c)\n}\n\n// UpdateSettingsByKey updates a single setting key-value in the DB.\nfunc (a *App) UpdateSettingsByKey(c echo.Context) error {\n\tkey := c.Param(\"key\")\n\tif key == \"\" {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidData\"))\n\t}\n\n\t// Read the raw JSON body as the value.\n\tvar b json.RawMessage\n\tif err := c.Bind(&b); err != nil {\n\t\treturn err\n\t}\n\n\t// Update the value in the DB.\n\tif err := a.core.UpdateSettingsByKey(key, b); err != nil {\n\t\treturn err\n\t}\n\n\treturn a.handleSettingsRestart(c)\n}\n\n// handleSettingsRestart checks for running campaigns and either triggers an\n// immediate app restart or marks the app as needing a restart.\nfunc (a *App) handleSettingsRestart(c echo.Context) error {\n\t// If there are any active campaigns, don't do an auto reload and\n\t// warn the user on the frontend.\n\tif a.manager.HasRunningCampaigns() {\n\t\ta.Lock()\n\t\ta.needsRestart = true\n\t\ta.Unlock()\n\n\t\treturn c.JSON(http.StatusOK, okResp{struct {\n\t\t\tNeedsRestart bool `json:\"needs_restart\"`\n\t\t}{true}})\n\t}\n\n\t// No running campaigns. Reload the app.\n\tgo func() {\n\t\t<-time.After(time.Millisecond * 500)\n\t\ta.chReload <- syscall.SIGHUP\n\t}()\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// GetLogs returns the log entries stored in the log buffer.\nfunc (a *App) GetLogs(c echo.Context) error {\n\treturn c.JSON(http.StatusOK, okResp{a.bufLog.Lines()})\n}\n\n// TestSMTPSettings returns the log entries stored in the log buffer.\nfunc (a *App) TestSMTPSettings(c echo.Context) error {\n\t// Copy the raw JSON post body.\n\treqBody, err := io.ReadAll(c.Request().Body)\n\tif err != nil {\n\t\ta.log.Printf(\"error reading SMTP test: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.internalError\"))\n\t}\n\n\t// Load the JSON into koanf to parse SMTP settings properly including timestrings.\n\tko := koanf.New(\".\")\n\tif err := ko.Load(rawbytes.Provider(reqBody), koanfjson.Parser()); err != nil {\n\t\ta.log.Printf(\"error unmarshalling SMTP test request: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.internalError\"))\n\t}\n\n\treq := email.Server{}\n\tif err := ko.UnmarshalWithConf(\"\", &req, koanf.UnmarshalConf{Tag: \"json\"}); err != nil {\n\t\ta.log.Printf(\"error scanning SMTP test request: %v\", err)\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.internalError\"))\n\t}\n\n\tto := ko.String(\"email\")\n\tif to == \"\" {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.missingFields\", \"name\", \"email\"))\n\t}\n\n\t// Initialize a new SMTP pool.\n\treq.MaxConns = 1\n\treq.IdleTimeout = time.Second * 2\n\treq.PoolWaitTimeout = time.Second * 2\n\tmsgr, err := email.New(\"\", req)\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorCreating\", \"name\", \"SMTP\", \"error\", err.Error()))\n\t}\n\n\t// Render the test email template body.\n\tvar b bytes.Buffer\n\tif err := notifs.Tpls.ExecuteTemplate(&b, \"smtp-test\", nil); err != nil {\n\t\ta.log.Printf(\"error compiling notification template '%s': %v\", \"smtp-test\", err)\n\t\treturn err\n\t}\n\n\tm := models.Message{}\n\tm.From = a.cfg.FromEmail\n\tm.To = []string{to}\n\tm.Subject = a.i18n.T(\"settings.smtp.testConnection\")\n\tm.Body = b.Bytes()\n\tif err := msgr.Push(m); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, err.Error())\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{a.bufLog.Lines()})\n}\n\nfunc (a *App) GetAboutInfo(c echo.Context) error {\n\tvar mem runtime.MemStats\n\truntime.ReadMemStats(&mem)\n\n\tout := a.about\n\tout.System.AllocMB = mem.Alloc / 1024 / 1024\n\tout.System.OSMB = mem.Sys / 1024 / 1024\n\n\treturn c.JSON(http.StatusOK, out)\n}\n" }, { "path": "cmd/subscribers.go", "content": "package main\n\nimport (\n\t\"encoding/csv\"\n\t\"encoding/json\"\n\t\"fmt\"\n\t\"net/http\"\n\t\"net/textproto\"\n\t\"net/url\"\n\t\"strconv\"\n\t\"strings\"\n\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/internal/i18n\"\n\t\"github.com/knadh/listmonk/internal/notifs\"\n\t\"github.com/knadh/listmonk/internal/subimporter\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n\t\"github.com/lib/pq\"\n)\n\nconst (\n\tdummyUUID = \"00000000-0000-0000-0000-000000000000\"\n)\n\n// subQueryReq is a \"catch all\" struct for reading various\n// subscriber related requests.\ntype subQueryReq struct {\n\tSearch string `json:\"search\"`\n\tQuery string `json:\"query\"`\n\tListIDs []int `json:\"list_ids\"`\n\tTargetListIDs []int `json:\"target_list_ids\"`\n\tSubscriberIDs []int `json:\"ids\"`\n\tAction string `json:\"action\"`\n\tStatus string `json:\"status\"`\n\tSubscriptionStatus string `json:\"subscription_status\"`\n\tAll bool `json:\"all\"`\n}\n\n// subOptin contains the data that's passed to the double opt-in e-mail template.\ntype subOptin struct {\n\tmodels.Subscriber\n\n\tOptinURL string\n\tUnsubURL string\n\tLists []models.List\n}\n\nvar (\n\tdummySubscriber = models.Subscriber{\n\t\tEmail: \"demo@listmonk.app\",\n\t\tName: \"Demo Subscriber\",\n\t\tUUID: dummyUUID,\n\t\tAttribs: models.JSON{\"city\": \"Bengaluru\"},\n\t}\n)\n\n// GetSubscriber handles the retrieval of a single subscriber by ID.\nfunc (a *App) GetSubscriber(c echo.Context) error {\n\tuser := auth.GetUser(c)\n\n\t// Check if the user has access to at least one of the lists on the subscriber.\n\tid := getID(c)\n\tif err := a.hasSubPerm(user, []int{id}); err != nil {\n\t\treturn err\n\t}\n\n\t// Fetch the subscriber from the DB.\n\tout, err := a.core.GetSubscriber(id, \"\", \"\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetSubscriberActivity handles the retrieval of a subscriber's campaign views and link clicks.\nfunc (a *App) GetSubscriberActivity(c echo.Context) error {\n\tuser := auth.GetUser(c)\n\n\t// Check if the user has access to at least one of the lists on the subscriber.\n\tid := getID(c)\n\tif err := a.hasSubPerm(user, []int{id}); err != nil {\n\t\treturn err\n\t}\n\n\t// Fetch the subscriber activity from the DB.\n\tout, err := a.core.GetSubscriberActivity(id)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// QuerySubscribers handles querying subscribers based on an arbitrary SQL expression.\nfunc (a *App) QuerySubscribers(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Filter list IDs by permission.\n\tlistIDs, err := a.filterListQueryByPerm(\"list_id\", c.QueryParams(), user)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Does the user have the subscribers:sql_query permission?\n\tquery := formatSQLExp(c.FormValue(\"query\"))\n\tif query != \"\" {\n\t\tif !user.HasPerm(auth.PermSubscribersSqlQuery) {\n\t\t\treturn echo.NewHTTPError(http.StatusForbidden,\n\t\t\t\ta.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", auth.PermSubscribersSqlQuery))\n\t\t}\n\t}\n\n\tvar (\n\t\tsearchStr = strings.TrimSpace(c.FormValue(\"search\"))\n\t\tsubStatus = c.FormValue(\"subscription_status\")\n\t\torder = c.FormValue(\"order\")\n\t\torderBy = c.FormValue(\"order_by\")\n\t\tpg = a.pg.NewFromURL(c.Request().URL.Query())\n\t)\n\n\t// Query subscribers from the DB.\n\tres, total, err := a.core.QuerySubscribers(searchStr, query, listIDs, subStatus, order, orderBy, pg.Offset, pg.Limit)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tout := models.PageResults{\n\t\tQuery: query,\n\t\tSearch: searchStr,\n\t\tResults: res,\n\t\tTotal: total,\n\t\tPage: pg.Page,\n\t\tPerPage: pg.PerPage,\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// ExportSubscribers handles querying subscribers based on an arbitrary SQL expression.\nfunc (a *App) ExportSubscribers(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Filter list IDs by permission.\n\tlistIDs, err := a.filterListQueryByPerm(\"list_id\", c.QueryParams(), user)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Export only specific subscriber IDs?\n\tsubIDs, err := getQueryInts(\"id\", c.QueryParams())\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidID\"))\n\t}\n\n\t// Filter by subscription status\n\tsubStatus := c.QueryParam(\"subscription_status\")\n\n\t// Does the user have the subscribers:sql_query permission?\n\tvar (\n\t\tsearchStr = strings.TrimSpace(c.FormValue(\"search\"))\n\t\tquery = formatSQLExp(c.FormValue(\"query\"))\n\t)\n\tif query != \"\" {\n\t\tif !user.HasPerm(auth.PermSubscribersSqlQuery) {\n\t\t\treturn echo.NewHTTPError(http.StatusForbidden,\n\t\t\t\ta.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", auth.PermSubscribersSqlQuery))\n\t\t}\n\t}\n\n\t// Get the batched export iterator.\n\texp, err := a.core.ExportSubscribers(searchStr, query, subIDs, listIDs, subStatus, a.cfg.DBBatchSize)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tvar (\n\t\thdr = c.Response().Header()\n\t\twr = csv.NewWriter(c.Response())\n\t)\n\n\thdr.Set(echo.HeaderContentType, echo.MIMEOctetStream)\n\thdr.Set(\"Content-type\", \"text/csv\")\n\thdr.Set(echo.HeaderContentDisposition, \"attachment; filename=\"+\"subscribers.csv\")\n\thdr.Set(\"Content-Transfer-Encoding\", \"binary\")\n\thdr.Set(\"Cache-Control\", \"no-cache\")\n\twr.Write([]string{\"uuid\", \"email\", \"name\", \"attributes\", \"status\", \"created_at\", \"updated_at\"})\n\nloop:\n\t// Iterate in batches until there are no more subscribers to export.\n\tfor {\n\t\tout, err := exp()\n\t\tif err != nil {\n\t\t\treturn err\n\t\t}\n\t\tif len(out) == 0 {\n\t\t\tbreak\n\t\t}\n\n\t\tfor _, r := range out {\n\t\t\tif err = wr.Write([]string{r.UUID, r.Email, r.Name, r.Attribs, r.Status,\n\t\t\t\tr.CreatedAt.Time.String(), r.UpdatedAt.Time.String()}); err != nil {\n\t\t\t\ta.log.Printf(\"error streaming CSV export: %v\", err)\n\t\t\t\tbreak loop\n\t\t\t}\n\t\t}\n\n\t\t// Flush CSV to stream after each batch.\n\t\twr.Flush()\n\t}\n\n\treturn nil\n}\n\n// CreateSubscriber handles the creation of a new subscriber.\nfunc (a *App) CreateSubscriber(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Get and validate fields.\n\tvar req subimporter.SubReq\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\n\t// Validate fields.\n\treq, err := a.importer.ValidateFields(req)\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t}\n\n\t// Filter lists against the current user's permitted lists.\n\tlistIDs := user.FilterListsByPerm(auth.PermTypeManage, req.Lists)\n\n\t// Not a single permitted list?\n\tif len(req.Lists) > 0 && len(listIDs) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusForbidden, a.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", \"lists\"))\n\t}\n\n\t// Insert the subscriber into the DB.\n\tsub, _, err := a.core.InsertSubscriber(req.Subscriber, listIDs, nil, req.PreconfirmSubs, false)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{sub})\n}\n\n// UpdateSubscriber handles modification of a subscriber.\nfunc (a *App) UpdateSubscriber(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Get and validate fields.\n\treq := struct {\n\t\tmodels.Subscriber\n\t\tLists []int `json:\"lists\"`\n\t\tPreconfirmSubs bool `json:\"preconfirm_subscriptions\"`\n\t}{}\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\n\t// Sanitize and validate the email field.\n\tif em, err := a.importer.SanitizeEmail(req.Email); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t} else {\n\t\treq.Email = em\n\t}\n\n\tif req.Name != \"\" && !strHasLen(req.Name, 1, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"subscribers.invalidName\"))\n\t}\n\n\t// Filter lists against the current user's permitted lists.\n\tlistIDs := user.FilterListsByPerm(auth.PermTypeManage, req.Lists)\n\n\t// Not a single permitted list?\n\tif len(req.Lists) > 0 && len(listIDs) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusForbidden, a.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", \"lists\"))\n\t}\n\n\t// Update the subscriber in the DB.\n\tid := getID(c)\n\n\t// Get the user's permitted lists to pass to the update query so that lists on the subscribers\n\t// to which they don't have permissions are preserved/left as-is when deleteLists=true.\n\tallPerm, permittedLists := user.GetPermittedLists(auth.PermTypeManage)\n\tif allPerm {\n\t\tpermittedLists = []int{}\n\t}\n\n\tout, _, err := a.core.UpdateSubscriberWithLists(id, req.Subscriber, listIDs, nil, req.PreconfirmSubs, true, false, permittedLists)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// SubscriberSendOptin sends an optin confirmation e-mail to a subscriber.\nfunc (a *App) SubscriberSendOptin(c echo.Context) error {\n\t// Fetch the subscriber.\n\tid := getID(c)\n\tout, err := a.core.GetSubscriber(id, \"\", \"\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Trigger the opt-in confirmation e-mail hook.\n\tif _, err := a.fnOptinNotify(out, nil); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError, a.i18n.T(\"subscribers.errorSendingOptin\"))\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// BlocklistSubscriber handles the blocklisting of a given subscriber.\nfunc (a *App) BlocklistSubscriber(c echo.Context) error {\n\t// Update the subscribers in the DB.\n\tid := getID(c)\n\tif err := a.core.BlocklistSubscribers([]int{id}); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// BlocklistSubscribers handles the blocklisting of one or more subscribers.\nfunc (a *App) BlocklistSubscribers(c echo.Context) error {\n\tvar req subQueryReq\n\tif err := c.Bind(&req); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", err.Error()))\n\t}\n\tif len(req.SubscriberIDs) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", \"ids\"))\n\t}\n\n\t// Update the subscribers in the DB.\n\tif err := a.core.BlocklistSubscribers(req.SubscriberIDs); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// ManageSubscriberLists handles bulk addition or removal of subscribers\n// from or to one or more target lists.\n// It takes either an ID in the URI, or a list of IDs in the request body.\nfunc (a *App) ManageSubscriberLists(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Is it an /:id call?\n\tvar (\n\t\tpID = c.Param(\"id\")\n\t\tsubIDs []int\n\t)\n\tif pID != \"\" {\n\t\tid, _ := strconv.Atoi(pID)\n\t\tif id < 1 {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidID\"))\n\t\t}\n\t\tsubIDs = append(subIDs, id)\n\t}\n\n\tvar req subQueryReq\n\tif err := c.Bind(&req); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", err.Error()))\n\t}\n\tif len(req.SubscriberIDs) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"subscribers.errorNoIDs\"))\n\t}\n\tif len(subIDs) == 0 {\n\t\tsubIDs = req.SubscriberIDs\n\t}\n\tif len(req.TargetListIDs) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"subscribers.errorNoListsGiven\"))\n\t}\n\n\t// Filter lists against the current user's permitted lists.\n\tlistIDs := user.FilterListsByPerm(auth.PermTypeGet|auth.PermTypeManage, req.TargetListIDs)\n\n\t// User doesn't have the required list permissions.\n\tif len(listIDs) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusForbidden, a.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", \"lists\"))\n\t}\n\n\t// Run the action in the DB.\n\tvar err error\n\tswitch req.Action {\n\tcase \"add\":\n\t\terr = a.core.AddSubscriptions(subIDs, listIDs, req.Status)\n\tcase \"remove\":\n\t\terr = a.core.DeleteSubscriptions(subIDs, listIDs)\n\tcase \"unsubscribe\":\n\t\terr = a.core.UnsubscribeLists(subIDs, listIDs, nil)\n\tdefault:\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"subscribers.invalidAction\"))\n\t}\n\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DeleteSubscriber handles deletion of a single subscriber.\nfunc (a *App) DeleteSubscriber(c echo.Context) error {\n\t// Delete the subscribers from the DB.\n\tid := getID(c)\n\tif err := a.core.DeleteSubscribers([]int{id}, nil); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DeleteSubscribers handles bulk deletion of one or more subscribers.\nfunc (a *App) DeleteSubscribers(c echo.Context) error {\n\t// Multiple IDs.\n\tids, err := parseStringIDs(c.Request().URL.Query()[\"id\"])\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", err.Error()))\n\t}\n\tif len(ids) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.errorInvalidIDs\", \"error\", \"ids\"))\n\t}\n\n\t// Delete the subscribers from the DB.\n\tif err := a.core.DeleteSubscribers(ids, nil); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DeleteSubscribersByQuery bulk deletes based on an\n// arbitrary SQL expression.\nfunc (a *App) DeleteSubscribersByQuery(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\tvar req subQueryReq\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\n\treq.Search = strings.TrimSpace(req.Search)\n\treq.Query = formatSQLExp(req.Query)\n\tif req.All {\n\t\t// If the \"all\" flag is set, ignore any subquery that may be present.\n\t\treq.Search = \"\"\n\t\treq.Query = \"\"\n\t} else if req.Search == \"\" && req.Query == \"\" {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"query\"))\n\t}\n\n\t// Does the user have the subscribers:sql_query permission?\n\tif req.Query != \"\" {\n\t\tif !user.HasPerm(auth.PermSubscribersSqlQuery) {\n\t\t\treturn echo.NewHTTPError(http.StatusForbidden,\n\t\t\t\ta.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", auth.PermSubscribersSqlQuery))\n\t\t}\n\t}\n\n\t// Delete the subscribers from the DB.\n\tif err := a.core.DeleteSubscribersByQuery(req.Search, req.Query, req.ListIDs, req.SubscriptionStatus); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// BlocklistSubscribersByQuery bulk blocklists subscribers\n// based on an arbitrary SQL expression.\nfunc (a *App) BlocklistSubscribersByQuery(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\tvar req subQueryReq\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\n\treq.Search = strings.TrimSpace(req.Search)\n\treq.Query = formatSQLExp(req.Query)\n\tif req.All {\n\t\t// If the \"all\" flag is set, ignore any subquery that may be present.\n\t\treq.Search = \"\"\n\t\treq.Query = \"\"\n\t} else if req.Search == \"\" && req.Query == \"\" {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"query\"))\n\t}\n\t// Does the user have the subscribers:sql_query permission?\n\tif req.Query != \"\" {\n\t\tif !user.HasPerm(auth.PermSubscribersSqlQuery) {\n\t\t\treturn echo.NewHTTPError(http.StatusForbidden,\n\t\t\t\ta.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", auth.PermSubscribersSqlQuery))\n\t\t}\n\t}\n\n\t// Update the subscribers in the DB.\n\tif err := a.core.BlocklistSubscribersByQuery(req.Search, req.Query, req.ListIDs, req.SubscriptionStatus); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// ManageSubscriberListsByQuery bulk adds/removes/unsubscribes subscribers\n// from one or more lists based on an arbitrary SQL expression.\nfunc (a *App) ManageSubscriberListsByQuery(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\tvar req subQueryReq\n\tif err := c.Bind(&req); err != nil {\n\t\treturn err\n\t}\n\tif len(req.TargetListIDs) == 0 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.T(\"subscribers.errorNoListsGiven\"))\n\t}\n\n\treq.Search = strings.TrimSpace(req.Search)\n\treq.Query = formatSQLExp(req.Query)\n\n\t// Does the user have the subscribers:sql_query permission?\n\tif req.Query != \"\" {\n\t\tif !user.HasPerm(auth.PermSubscribersSqlQuery) {\n\t\t\treturn echo.NewHTTPError(http.StatusForbidden,\n\t\t\t\ta.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", auth.PermSubscribersSqlQuery))\n\t\t}\n\t}\n\n\t// Filter lists against the current user's permitted lists.\n\tsourceListIDs := user.FilterListsByPerm(auth.PermTypeGet|auth.PermTypeManage, req.ListIDs)\n\ttargetListIDs := user.FilterListsByPerm(auth.PermTypeGet|auth.PermTypeManage, req.TargetListIDs)\n\n\t// Run the action in the DB.\n\tvar err error\n\tswitch req.Action {\n\tcase \"add\":\n\t\terr = a.core.AddSubscriptionsByQuery(req.Search, req.Query, sourceListIDs, targetListIDs, req.Status, req.SubscriptionStatus)\n\tcase \"remove\":\n\t\terr = a.core.DeleteSubscriptionsByQuery(req.Search, req.Query, sourceListIDs, targetListIDs, req.SubscriptionStatus)\n\tcase \"unsubscribe\":\n\t\terr = a.core.UnsubscribeListsByQuery(req.Search, req.Query, sourceListIDs, targetListIDs, req.SubscriptionStatus)\n\tdefault:\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"subscribers.invalidAction\"))\n\t}\n\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DeleteSubscriberBounces deletes all the bounces on a subscriber.\nfunc (a *App) DeleteSubscriberBounces(c echo.Context) error {\n\t// Delete the bounces from the DB.\n\tid := getID(c)\n\tif err := a.core.DeleteSubscriberBounces(id, \"\"); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// ExportSubscriberData pulls the subscriber's profile,\n// list subscriptions, campaign views and clicks and produces\n// a JSON report. This is a privacy feature and depends on the\n// configuration in a.Constants.Privacy.\nfunc (a *App) ExportSubscriberData(c echo.Context) error {\n\t// Get the subscriber's data. A single query that gets the profile,\n\t// list subscriptions, campaign views, and link clicks. Names of\n\t// private lists are replaced with \"Private list\".\n\tid := getID(c)\n\t_, b, err := a.exportSubscriberData(id, \"\", a.cfg.Privacy.Exportable)\n\tif err != nil {\n\t\ta.log.Printf(\"error exporting subscriber data: %s\", err)\n\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\ta.i18n.Ts(\"globals.messages.errorFetching\", \"name\", \"{globals.terms.subscribers}\", \"error\", err.Error()))\n\t}\n\n\t// Set headers to force the browser to prompt for download.\n\tc.Response().Header().Set(\"Cache-Control\", \"no-cache\")\n\tc.Response().Header().Set(\"Content-Disposition\", `attachment; filename=\"data.json\"`)\n\treturn c.Blob(http.StatusOK, \"application/json\", b)\n}\n\n// exportSubscriberData collates the data of a subscriber including profile,\n// subscriptions, campaign_views, link_clicks (if they're enabled in the config)\n// and returns a formatted, indented JSON payload. Either takes a numeric id\n// and an empty subUUID or takes 0 and a string subUUID.\nfunc (a *App) exportSubscriberData(id int, subUUID string, exportables map[string]bool) (models.SubscriberExportProfile, []byte, error) {\n\tdata, err := a.core.GetSubscriberProfileForExport(id, subUUID)\n\tif err != nil {\n\t\treturn data, nil, err\n\t}\n\n\t// Filter out the non-exportable items.\n\tif _, ok := exportables[\"profile\"]; !ok {\n\t\tdata.Profile = nil\n\t}\n\tif _, ok := exportables[\"subscriptions\"]; !ok {\n\t\tdata.Subscriptions = nil\n\t}\n\tif _, ok := exportables[\"campaign_views\"]; !ok {\n\t\tdata.CampaignViews = nil\n\t}\n\tif _, ok := exportables[\"link_clicks\"]; !ok {\n\t\tdata.LinkClicks = nil\n\t}\n\n\t// Marshal the data into an indented payload.\n\tb, err := json.MarshalIndent(data, \"\", \" \")\n\tif err != nil {\n\t\ta.log.Printf(\"error marshalling subscriber export data: %v\", err)\n\t\treturn data, nil, err\n\t}\n\n\treturn data, b, nil\n}\n\n// hasSubPerm checks whether the current user has permission to access the given list\n// of subscriber IDs.\nfunc (a *App) hasSubPerm(u auth.User, subIDs []int) error {\n\tallPerm, listIDs := u.GetPermittedLists(auth.PermTypeGet | auth.PermTypeManage)\n\n\t// User has blanket get_all|manage_all permission.\n\tif allPerm {\n\t\treturn nil\n\t}\n\n\t// Check whether the subscribers have the list IDs permitted to the user.\n\tres, err := a.core.HasSubscriberLists(subIDs, listIDs)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\tfor id, has := range res {\n\t\tif !has {\n\t\t\treturn echo.NewHTTPError(http.StatusForbidden, a.i18n.Ts(\"globals.messages.permissionDenied\", \"name\", fmt.Sprintf(\"subscriber: %d\", id)))\n\t\t}\n\t}\n\n\treturn nil\n}\n\n// filterListQueryByPerm filters the list IDs in the query params and returns the list IDs to which the user has access.\nfunc (a *App) filterListQueryByPerm(param string, qp url.Values, user auth.User) ([]int, error) {\n\tvar listIDs []int\n\n\t// If there are incoming list query params, filter them by permission.\n\tif qp.Has(param) {\n\t\tids, err := getQueryInts(param, qp)\n\t\tif err != nil {\n\t\t\treturn nil, echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidID\"))\n\t\t}\n\n\t\tlistIDs = user.FilterListsByPerm(auth.PermTypeGet|auth.PermTypeManage, ids)\n\t}\n\n\t// There are no incoming params. If the user doesn't have permission to get all subscribers,\n\t// filter by the lists they have access to.\n\tif len(listIDs) == 0 {\n\t\tif _, ok := user.PermissionsMap[auth.PermSubscribersGetAll]; !ok {\n\t\t\tif len(user.GetListIDs) > 0 {\n\t\t\t\tlistIDs = user.GetListIDs\n\t\t\t} else {\n\t\t\t\t// User doesn't have access to any lists.\n\t\t\t\tlistIDs = []int{-1}\n\t\t\t}\n\t\t}\n\t}\n\n\treturn listIDs, nil\n}\n\n// formatSQLExp does basic sanitisation on arbitrary\n// SQL query expressions coming from the frontend.\nfunc formatSQLExp(q string) string {\n\tq = strings.TrimSpace(q)\n\tif len(q) == 0 {\n\t\treturn \"\"\n\t}\n\n\t// Remove semicolon suffix.\n\tif q[len(q)-1] == ';' {\n\t\tq = q[:len(q)-1]\n\t}\n\treturn q\n}\n\n// makeOptinNotifyHook returns an enclosed callback that sends optin confirmation e-mails.\n// This is plugged into the 'core' package to send optin confirmations when a new subscriber is\n// created via `core.CreateSubscriber()`.\nfunc makeOptinNotifyHook(unsubHeader bool, u *UrlConfig, q *models.Queries, i *i18n.I18n) func(sub models.Subscriber, listIDs []int) (int, error) {\n\treturn func(sub models.Subscriber, listIDs []int) (int, error) {\n\t\t// Fetch double opt-in lists from the given list IDs.\n\t\t// Get the list of subscription lists where the subscriber hasn't confirmed.\n\t\tvar lists = []models.List{}\n\t\tif err := q.GetSubscriberLists.Select(&lists, sub.ID, nil, pq.Array(listIDs), nil, models.SubscriptionStatusUnconfirmed, models.ListOptinDouble); err != nil {\n\t\t\tlo.Printf(\"error fetching lists for opt-in: %s\", err)\n\t\t\treturn 0, err\n\t\t}\n\n\t\t// None.\n\t\tif len(lists) == 0 {\n\t\t\treturn 0, nil\n\t\t}\n\n\t\tvar (\n\t\t\tout = subOptin{Subscriber: sub, Lists: lists}\n\t\t\tqListIDs = url.Values{}\n\t\t)\n\n\t\t// Construct the opt-in URL with list IDs.\n\t\tfor _, l := range out.Lists {\n\t\t\tqListIDs.Add(\"l\", l.UUID)\n\t\t}\n\t\tout.OptinURL = fmt.Sprintf(u.OptinURL, sub.UUID, qListIDs.Encode())\n\t\tout.UnsubURL = fmt.Sprintf(u.UnsubURL, dummyUUID, sub.UUID)\n\n\t\t// Unsub headers.\n\t\thdr := textproto.MIMEHeader{}\n\t\thdr.Set(models.EmailHeaderSubscriberUUID, sub.UUID)\n\n\t\t// Attach List-Unsubscribe headers?\n\t\tif unsubHeader {\n\t\t\tunsubURL := fmt.Sprintf(u.UnsubURL, dummyUUID, sub.UUID)\n\t\t\thdr.Set(\"List-Unsubscribe-Post\", \"List-Unsubscribe=One-Click\")\n\t\t\thdr.Set(\"List-Unsubscribe\", `<`+unsubURL+`>`)\n\t\t}\n\n\t\t// Send the e-mail.\n\t\tif err := notifs.Notify([]string{sub.Email}, i.T(\"subscribers.optinSubject\"), notifs.TplSubscriberOptin, out, hdr); err != nil {\n\t\t\tlo.Printf(\"error sending opt-in e-mail for subscriber %d (%s): %s\", sub.ID, sub.UUID, err)\n\t\t\treturn 0, err\n\t\t}\n\n\t\treturn len(lists), nil\n\t}\n}\n" }, { "path": "cmd/templates.go", "content": "package main\n\nimport (\n\t\"errors\"\n\t\"html/template\"\n\t\"net/http\"\n\t\"regexp\"\n\t\"strconv\"\n\t\"strings\"\n\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n)\n\nconst (\n\t// tplTag is the template tag that should be present in a template\n\t// as the placeholder for campaign bodies.\n\ttplTag = `{{ template \"content\" . }}`\n\n\tdummyTpl = `\n\t\tHi there
\n\t\tLorem ipsum dolor sit amet, consectetur adipiscing elit. Duis et elit ac elit sollicitudin condimentum non a magna. Sed tempor mauris in facilisis vehicula. Aenean nisl urna, accumsan ac tincidunt vitae, interdum cursus massa. Interdum et malesuada fames ac ante ipsum primis in faucibus. Aliquam varius turpis et turpis lacinia placerat. Aenean id ligula a orci lacinia blandit at eu felis. Phasellus vel lobortis lacus. Suspendisse leo elit, luctus sed erat ut, venenatis fermentum ipsum. Donec bibendum neque quis.
\n\n\t\tSub heading
\n\t\tNam luctus dui non placerat mattis. Morbi non accumsan orci, vel interdum urna. Duis faucibus id nunc ut euismod. Curabitur et eros id erat feugiat fringilla in eget neque. Aliquam accumsan cursus eros sed faucibus.
\n\n\t\tHere is a link to listmonk.
`\n)\n\nvar (\n\tregexpTplTag = regexp.MustCompile(`{{(\\s+)?template\\s+?\"content\"(\\s+)?\\.(\\s+)?}}`)\n)\n\n// GetTemplate handles the retrieval of a template\nfunc (a *App) GetTemplate(c echo.Context) error {\n\t// If no_body is true, blank out the body of the template from the response.\n\tnoBody, _ := strconv.ParseBool(c.QueryParam(\"no_body\"))\n\n\t// Get the template from the DB.\n\tid := getID(c)\n\tout, err := a.core.GetTemplate(id, noBody)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetTemplates handles retrieval of templates.\nfunc (a *App) GetTemplates(c echo.Context) error {\n\t// If no_body is true, blank out the body of the template from the response.\n\tnoBody, _ := strconv.ParseBool(c.QueryParam(\"no_body\"))\n\n\t// Fetch templates from the DB.\n\tout, err := a.core.GetTemplates(\"\", noBody)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// PreviewTemplate renders the HTML preview of a template in the DB.\nfunc (a *App) PreviewTemplate(c echo.Context) error {\n\t// Fetch one template from the DB.\n\tid := getID(c)\n\ttpl, err := a.core.GetTemplate(id, false)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Render the template.\n\tout, err := a.previewTemplate(tpl)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.HTML(http.StatusOK, string(out))\n}\n\n// PreviewTemplateBody renders the HTML preview of a template given its type and body.\nfunc (a *App) PreviewTemplateBody(c echo.Context) error {\n\ttpl := models.Template{\n\t\tType: c.FormValue(\"template_type\"),\n\t\tBody: c.FormValue(\"body\"),\n\t}\n\n\t// Body is posted with the request.\n\tif tpl.Type == \"\" {\n\t\ttpl.Type = models.TemplateTypeCampaign\n\t}\n\n\tif tpl.Type == models.TemplateTypeCampaign && !regexpTplTag.MatchString(tpl.Body) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"templates.placeholderHelp\", \"placeholder\", tplTag))\n\t}\n\n\t// Render the template.\n\tout, err := a.previewTemplate(tpl)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\treturn c.HTML(http.StatusOK, string(out))\n}\n\n// CreateTemplate handles template creation.\nfunc (a *App) CreateTemplate(c echo.Context) error {\n\tvar o models.Template\n\tif err := c.Bind(&o); err != nil {\n\t\treturn err\n\t}\n\tif err := a.validateTemplate(o); err != nil {\n\t\treturn err\n\t}\n\n\t// Subject is only relevant for fixed tx templates. For campaigns,\n\t// the subject changes per campaign and is on models.Campaign.\n\tvar funcs template.FuncMap\n\tif o.Type == models.TemplateTypeCampaign || o.Type == models.TemplateTypeCampaignVisual {\n\t\to.Subject = \"\"\n\t\tfuncs = a.manager.TemplateFuncs(nil)\n\t} else {\n\t\tfuncs = a.manager.GenericTemplateFuncs()\n\t}\n\n\t// Compile the template and validate.\n\tif err := o.Compile(funcs); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t}\n\n\t// Create the template the in the DB.\n\tout, err := a.core.CreateTemplate(o.Name, o.Type, o.Subject, []byte(o.Body), o.BodySource)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// If it's a transactional template, cache it in the manager\n\t// to be used for arbitrary incoming tx message pushes.\n\tif o.Type == models.TemplateTypeTx {\n\t\ta.manager.CacheTpl(out.ID, &o)\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// UpdateTemplate handles template modification.\nfunc (a *App) UpdateTemplate(c echo.Context) error {\n\tvar o models.Template\n\tif err := c.Bind(&o); err != nil {\n\t\treturn err\n\t}\n\tif err := a.validateTemplate(o); err != nil {\n\t\treturn err\n\t}\n\n\t// Subject is only relevant for fixed tx templates. For campaigns,\n\t// the subject changes per campaign and is on models.Campaign.\n\tvar funcs template.FuncMap\n\tif o.Type == models.TemplateTypeCampaign || o.Type == models.TemplateTypeCampaignVisual {\n\t\to.Subject = \"\"\n\t\tfuncs = a.manager.TemplateFuncs(nil)\n\t} else {\n\t\tfuncs = a.manager.GenericTemplateFuncs()\n\t}\n\n\t// Compile the template and validate.\n\tif err := o.Compile(funcs); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t}\n\n\t// Update the template in the DB.\n\tid := getID(c)\n\tout, err := a.core.UpdateTemplate(id, o.Name, o.Subject, []byte(o.Body), o.BodySource)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// If it's a transactional template, cache it.\n\tif out.Type == models.TemplateTypeTx {\n\t\ta.manager.CacheTpl(out.ID, &o)\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n\n}\n\n// TemplateSetDefault handles template modification.\nfunc (a *App) TemplateSetDefault(c echo.Context) error {\n\t// Update the template in the DB.\n\tid := getID(c)\n\tif err := a.core.SetDefaultTemplate(id); err != nil {\n\t\treturn err\n\t}\n\n\treturn a.GetTemplates(c)\n}\n\n// DeleteTemplate handles template deletion.\nfunc (a *App) DeleteTemplate(c echo.Context) error {\n\t// Delete the template from the DB.\n\tid := getID(c)\n\tif err := a.core.DeleteTemplate(id); err != nil {\n\t\treturn err\n\t}\n\n\t// Delete cached in-memory template.\n\ta.manager.DeleteTpl(id)\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// compileTemplate validates template fields.\nfunc (a *App) validateTemplate(o models.Template) error {\n\tif !strHasLen(o.Name, 1, stdInputMaxLen) {\n\t\treturn errors.New(a.i18n.T(\"campaigns.fieldInvalidName\"))\n\t}\n\n\tif o.Type == models.TemplateTypeCampaign && !regexpTplTag.MatchString(o.Body) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"templates.placeholderHelp\", \"placeholder\", tplTag))\n\t}\n\n\tif o.Type == models.TemplateTypeTx && strings.TrimSpace(o.Subject) == \"\" {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.missingFields\", \"name\", \"subject\"))\n\t}\n\n\treturn nil\n}\n\n// previewTemplate renders the HTML preview of a template.\nfunc (a *App) previewTemplate(tpl models.Template) ([]byte, error) {\n\tvar out []byte\n\tif tpl.Type == models.TemplateTypeCampaign || tpl.Type == models.TemplateTypeCampaignVisual {\n\t\tcamp := models.Campaign{\n\t\t\tUUID: dummyUUID,\n\t\t\tName: a.i18n.T(\"templates.dummyName\"),\n\t\t\tSubject: a.i18n.T(\"templates.dummySubject\"),\n\t\t\tFromEmail: \"dummy-campaign@listmonk.app\",\n\t\t\tTemplateBody: tpl.Body,\n\t\t\tBody: dummyTpl,\n\t\t}\n\n\t\tif err := camp.CompileTemplate(a.manager.TemplateFuncs(&camp)); err != nil {\n\t\t\treturn nil, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"templates.errorCompiling\", \"error\", err.Error()))\n\t\t}\n\n\t\t// Render the message body.\n\t\tmsg, err := a.manager.NewCampaignMessage(&camp, dummySubscriber)\n\t\tif err != nil {\n\t\t\treturn nil, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"templates.errorRendering\", \"error\", err.Error()))\n\t\t}\n\t\tout = msg.Body()\n\t} else {\n\t\t// Compile transactional template.\n\t\tif err := tpl.Compile(a.manager.GenericTemplateFuncs()); err != nil {\n\t\t\treturn nil, echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t\t}\n\n\t\tm := models.TxMessage{\n\t\t\tSubject: tpl.Subject,\n\t\t}\n\n\t\t// Render the message.\n\t\tif err := m.Render(dummySubscriber, &tpl, a.manager.GenericTemplateFuncs()); err != nil {\n\t\t\treturn nil, echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t\t}\n\t\tout = m.Body\n\t}\n\n\treturn out, nil\n}\n" }, { "path": "cmd/tx.go", "content": "package main\n\nimport (\n\t\"encoding/json\"\n\t\"fmt\"\n\t\"io\"\n\t\"net/http\"\n\t\"net/textproto\"\n\t\"strings\"\n\n\t\"github.com/knadh/listmonk/internal/manager\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n)\n\n// SendTxMessage handles the sending of a transactional message.\nfunc (a *App) SendTxMessage(c echo.Context) error {\n\tvar m models.TxMessage\n\n\t// If it's a multipart form, there may be file attachments.\n\tif strings.HasPrefix(c.Request().Header.Get(\"Content-Type\"), \"multipart/form-data\") {\n\t\tform, err := c.MultipartForm()\n\t\tif err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", err.Error()))\n\t\t}\n\n\t\tdata, ok := form.Value[\"data\"]\n\t\tif !ok || len(data) != 1 {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"data\"))\n\t\t}\n\n\t\t// Parse the JSON data.\n\t\tif err := json.Unmarshal([]byte(data[0]), &m); err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", fmt.Sprintf(\"data: %s\", err.Error())))\n\t\t}\n\n\t\t// Attach files.\n\t\tfor _, f := range form.File[\"file\"] {\n\t\t\tfile, err := f.Open()\n\t\t\tif err != nil {\n\t\t\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", fmt.Sprintf(\"file: %s\", err.Error())))\n\t\t\t}\n\t\t\tdefer file.Close()\n\n\t\t\tb, err := io.ReadAll(file)\n\t\t\tif err != nil {\n\t\t\t\treturn echo.NewHTTPError(http.StatusInternalServerError,\n\t\t\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", fmt.Sprintf(\"file: %s\", err.Error())))\n\t\t\t}\n\n\t\t\tm.Attachments = append(m.Attachments, models.Attachment{\n\t\t\t\tName: f.Filename,\n\t\t\t\tHeader: manager.MakeAttachmentHeader(f.Filename, \"base64\", f.Header.Get(\"Content-Type\")),\n\t\t\t\tContent: b,\n\t\t\t})\n\t\t}\n\n\t} else if err := c.Bind(&m); err != nil {\n\t\treturn err\n\t}\n\n\t// Validate fields.\n\tif r, err := a.validateTxMessage(m); err != nil {\n\t\treturn err\n\t} else {\n\t\tm = r\n\t}\n\n\t// Get the cached tx template.\n\ttpl, err := a.manager.GetTpl(m.TemplateID)\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.notFound\", \"name\", fmt.Sprintf(\"template %d\", m.TemplateID)))\n\t}\n\n\tvar (\n\t\tnum = len(m.SubscriberEmails)\n\t\tisEmails = true\n\t)\n\tif len(m.SubscriberIDs) > 0 {\n\t\tnum = len(m.SubscriberIDs)\n\t\tisEmails = false\n\t}\n\n\tnotFound := []string{}\n\tfor n := range num {\n\t\tvar sub models.Subscriber\n\n\t\tif m.SubscriberMode == models.TxSubModeExternal {\n\t\t\t// `external`: Always create an ephemeral \"subscriber\" and don't\n\t\t\t// lookup in the DB.\n\t\t\tsub = models.Subscriber{\n\t\t\t\tEmail: m.SubscriberEmails[n],\n\t\t\t}\n\t\t} else {\n\t\t\t// Default/fallback mode: lookup subscriber in DB.\n\t\t\tvar (\n\t\t\t\tsubID int\n\t\t\t\tsubEmail string\n\t\t\t)\n\n\t\t\tif !isEmails {\n\t\t\t\tsubID = m.SubscriberIDs[n]\n\t\t\t} else {\n\t\t\t\tsubEmail = m.SubscriberEmails[n]\n\t\t\t}\n\n\t\t\tvar err error\n\t\t\tsub, err = a.core.GetSubscriber(subID, \"\", subEmail)\n\t\t\tif err != nil {\n\t\t\t\tif er, ok := err.(*echo.HTTPError); ok && er.Code == http.StatusBadRequest {\n\t\t\t\t\t// `fallback`: Create an ephemeral \"subscriber\" if the subscriber wasn't found.\n\t\t\t\t\tif m.SubscriberMode == models.TxSubModeFallback {\n\t\t\t\t\t\tsub = models.Subscriber{\n\t\t\t\t\t\t\tEmail: subEmail,\n\t\t\t\t\t\t}\n\t\t\t\t\t} else {\n\t\t\t\t\t\t// `default`: log error and continue.\n\t\t\t\t\t\tnotFound = append(notFound, fmt.Sprintf(\"%v\", er.Message))\n\t\t\t\t\t\tcontinue\n\t\t\t\t\t}\n\t\t\t\t} else {\n\t\t\t\t\treturn err\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\n\t\t// Render the message.\n\t\tif err := m.Render(sub, tpl, a.manager.GenericTemplateFuncs()); err != nil {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.errorFetching\", \"name\"))\n\t\t}\n\n\t\t// Prepare the final message.\n\t\tmsg := models.Message{}\n\t\tmsg.Subscriber = sub\n\t\tmsg.To = []string{sub.Email}\n\t\tmsg.From = m.FromEmail\n\t\tmsg.Subject = m.Subject\n\t\tmsg.ContentType = m.ContentType\n\t\tmsg.Messenger = m.Messenger\n\t\tmsg.Body = m.Body\n\t\tmsg.AltBody = []byte(m.AltBody)\n\t\tfor _, a := range m.Attachments {\n\t\t\tmsg.Attachments = append(msg.Attachments, models.Attachment{\n\t\t\t\tName: a.Name,\n\t\t\t\tHeader: a.Header,\n\t\t\t\tContent: a.Content,\n\t\t\t})\n\t\t}\n\n\t\t// Optional headers.\n\t\tif len(m.Headers) != 0 {\n\t\t\tmsg.Headers = make(textproto.MIMEHeader, len(m.Headers))\n\t\t\tfor _, set := range m.Headers {\n\t\t\t\tfor hdr, val := range set {\n\t\t\t\t\tmsg.Headers.Add(hdr, val)\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\n\t\tif err := a.manager.PushMessage(msg); err != nil {\n\t\t\ta.log.Printf(\"error sending message (%s): %v\", msg.Subject, err)\n\t\t\treturn err\n\t\t}\n\t}\n\n\tif len(notFound) > 0 {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, strings.Join(notFound, \"; \"))\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// validateTxMessage validates the tx message fields.\nfunc (a *App) validateTxMessage(m models.TxMessage) (models.TxMessage, error) {\n\tif len(m.SubscriberEmails) > 0 && m.SubscriberEmail != \"\" {\n\t\treturn m, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"do not send `subscriber_email`\"))\n\t}\n\tif len(m.SubscriberIDs) > 0 && m.SubscriberID != 0 {\n\t\treturn m, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"do not send `subscriber_id`\"))\n\t}\n\n\tif m.SubscriberEmail != \"\" {\n\t\tm.SubscriberEmails = append(m.SubscriberEmails, m.SubscriberEmail)\n\t}\n\n\tif m.SubscriberID != 0 {\n\t\tm.SubscriberIDs = append(m.SubscriberIDs, m.SubscriberID)\n\t}\n\n\t// Validate subscriber_mode.\n\tif m.SubscriberMode == \"\" {\n\t\tm.SubscriberMode = models.TxSubModeDefault\n\t}\n\n\tswitch m.SubscriberMode {\n\tcase models.TxSubModeDefault:\n\t\t// Need subscriber_emails OR subscriber_ids, but not both.\n\t\tif (len(m.SubscriberEmails) == 0 && len(m.SubscriberIDs) == 0) || (len(m.SubscriberEmails) > 0 && len(m.SubscriberIDs) > 0) {\n\t\t\treturn m, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"send subscriber_emails OR subscriber_ids\"))\n\t\t}\n\tcase models.TxSubModeFallback, models.TxSubModeExternal:\n\t\t// `fallback` and `external` can only use subscriber_emails.\n\t\tif len(m.SubscriberIDs) > 0 {\n\t\t\treturn m, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"subscriber_ids not allowed in fallback or external mode\"))\n\t\t}\n\t\tif len(m.SubscriberEmails) == 0 {\n\t\t\treturn m, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"subscriber_emails\"))\n\t\t}\n\tdefault:\n\t\treturn m, echo.NewHTTPError(http.StatusBadRequest,\n\t\t\ta.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"subscriber_mode\"))\n\t}\n\n\tfor n, email := range m.SubscriberEmails {\n\t\tif email != \"\" {\n\t\t\tem, err := a.importer.SanitizeEmail(email)\n\t\t\tif err != nil {\n\t\t\t\treturn m, echo.NewHTTPError(http.StatusBadRequest, err.Error())\n\t\t\t}\n\t\t\tm.SubscriberEmails[n] = em\n\t\t}\n\t}\n\n\tif m.FromEmail == \"\" {\n\t\tm.FromEmail = a.cfg.FromEmail\n\t}\n\n\tif m.Messenger == \"\" {\n\t\tm.Messenger = emailMsgr\n\t} else if !a.manager.HasMessenger(m.Messenger) {\n\t\treturn m, echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"campaigns.fieldInvalidMessenger\", \"name\", m.Messenger))\n\t}\n\n\treturn m, nil\n}\n" }, { "path": "cmd/updates.go", "content": "package main\n\nimport (\n\t\"encoding/json\"\n\t\"io\"\n\t\"net/http\"\n\t\"regexp\"\n\t\"time\"\n\n\t\"golang.org/x/mod/semver\"\n)\n\nconst updateCheckURL = \"https://update.listmonk.app/update.json\"\n\ntype AppUpdate struct {\n\tUpdate struct {\n\t\tReleaseVersion string `json:\"release_version\"`\n\t\tReleaseDate string `json:\"release_date\"`\n\t\tURL string `json:\"url\"`\n\t\tDescription string `json:\"description\"`\n\n\t\t// This is computed and set locally based on the local version.\n\t\tIsNew bool `json:\"is_new\"`\n\t} `json:\"update\"`\n\tMessages []struct {\n\t\tDate string `json:\"date\"`\n\t\tTitle string `json:\"title\"`\n\t\tDescription string `json:\"description\"`\n\t\tURL string `json:\"url\"`\n\t\tPriority string `json:\"priority\"`\n\t} `json:\"messages\"`\n}\n\nvar reSemver = regexp.MustCompile(`-(.*)`)\n\n// checkUpdates is a blocking function that checks for updates to the app\n// at the given intervals. On detecting a new update (new semver), it\n// sets the global update status that renders a prompt on the UI.\nfunc (a *App) checkUpdates(curVersion string, interval time.Duration) {\n\t// Strip -* suffix.\n\tcurVersion = reSemver.ReplaceAllString(curVersion, \"\")\n\n\tfnCheck := func() {\n\t\tresp, err := http.Get(updateCheckURL)\n\t\tif err != nil {\n\t\t\ta.log.Printf(\"error checking for remote update: %v\", err)\n\t\t\treturn\n\t\t}\n\n\t\tif resp.StatusCode != 200 {\n\t\t\ta.log.Printf(\"non 200 response on remote update check: %d\", resp.StatusCode)\n\t\t\treturn\n\t\t}\n\n\t\tb, err := io.ReadAll(resp.Body)\n\t\tif err != nil {\n\t\t\ta.log.Printf(\"error reading remote update payload: %v\", err)\n\t\t\treturn\n\t\t}\n\t\tresp.Body.Close()\n\n\t\tvar out AppUpdate\n\t\tif err := json.Unmarshal(b, &out); err != nil {\n\t\t\ta.log.Printf(\"error unmarshalling remote update payload: %v\", err)\n\t\t\treturn\n\t\t}\n\n\t\t// There is an update. Set it on the global app state.\n\t\tif semver.IsValid(out.Update.ReleaseVersion) {\n\t\t\tv := reSemver.ReplaceAllString(out.Update.ReleaseVersion, \"\")\n\t\t\tif semver.Compare(v, curVersion) > 0 {\n\t\t\t\tout.Update.IsNew = true\n\t\t\t\ta.log.Printf(\"new update %s found\", out.Update.ReleaseVersion)\n\t\t\t}\n\t\t}\n\n\t\ta.Lock()\n\t\ta.update = &out\n\t\ta.Unlock()\n\t}\n\n\t// Give a 15 minute buffer after app start in case the admin wants to disable\n\t// update checks entirely and not make a request to upstream.\n\ttime.Sleep(time.Minute * 15)\n\tfnCheck()\n\n\t// Thereafter, check every $interval.\n\tticker := time.NewTicker(interval)\n\tdefer ticker.Stop()\n\n\tfor range ticker.C {\n\t\tfnCheck()\n\t}\n}\n" }, { "path": "cmd/upgrade.go", "content": "package main\n\nimport (\n\t\"fmt\"\n\t\"log\"\n\t\"strings\"\n\n\t\"github.com/jmoiron/sqlx\"\n\t\"github.com/knadh/koanf/v2\"\n\t\"github.com/knadh/listmonk/internal/migrations\"\n\t\"github.com/knadh/stuffbin\"\n\t\"github.com/lib/pq\"\n\t\"golang.org/x/mod/semver\"\n)\n\n// migFunc represents a migration function for a particular version.\n// fn (generally) executes database migrations and additionally\n// takes the filesystem and config objects in case there are additional bits\n// of logic to be performed before executing upgrades. fn is idempotent.\ntype migFunc struct {\n\tversion string\n\tfn func(*sqlx.DB, stuffbin.FileSystem, *koanf.Koanf, *log.Logger) error\n}\n\n// migList is the list of available migList ordered by the semver.\n// Each migration is a Go file in internal/migrations named after the semver.\n// The functions are named as: v0.7.0 => migrations.V0_7_0() and are idempotent.\nvar migList = []migFunc{\n\t{\"v0.4.0\", migrations.V0_4_0},\n\t{\"v0.7.0\", migrations.V0_7_0},\n\t{\"v0.8.0\", migrations.V0_8_0},\n\t{\"v0.9.0\", migrations.V0_9_0},\n\t{\"v1.0.0\", migrations.V1_0_0},\n\t{\"v2.0.0\", migrations.V2_0_0},\n\t{\"v2.1.0\", migrations.V2_1_0},\n\t{\"v2.2.0\", migrations.V2_2_0},\n\t{\"v2.3.0\", migrations.V2_3_0},\n\t{\"v2.4.0\", migrations.V2_4_0},\n\t{\"v2.5.0\", migrations.V2_5_0},\n\t{\"v3.0.0\", migrations.V3_0_0},\n\t{\"v4.0.0\", migrations.V4_0_0},\n\t{\"v4.1.0\", migrations.V4_1_0},\n\t{\"v5.0.0\", migrations.V5_0_0},\n\t{\"v5.1.0\", migrations.V5_1_0},\n\t{\"v6.0.0\", migrations.V6_0_0},\n\t{\"v6.1.0\", migrations.V6_1_0},\n}\n\n// upgrade upgrades the database to the current version by running SQL migration files\n// for all version from the last known version to the current one.\n// If record is false, migration versions are not recorded in the DB (used for nightly builds).\nfunc upgrade(db *sqlx.DB, fs stuffbin.FileSystem, prompt bool, record bool) {\n\tif prompt {\n\t\tvar ok string\n\t\tfmt.Printf(\"** IMPORTANT: Take a backup of the database before upgrading.\\n\")\n\t\tfmt.Print(\"continue (y/n)? \")\n\t\tif _, err := fmt.Scanf(\"%s\", &ok); err != nil {\n\t\t\tlo.Fatalf(\"error reading value from terminal: %v\", err)\n\t\t}\n\t\tif strings.ToLower(ok) != \"y\" {\n\t\t\tfmt.Println(\"upgrade cancelled\")\n\t\t\treturn\n\t\t}\n\t}\n\n\t_, toRun, err := getPendingMigrations(db)\n\tif err != nil {\n\t\tlo.Fatalf(\"error checking migrations: %v\", err)\n\t}\n\n\t// No migrations to run.\n\tif len(toRun) == 0 {\n\t\tlo.Printf(\"no upgrades to run. Database is up to date.\")\n\t\treturn\n\t}\n\n\t// Execute migrations in succession.\n\tfor _, m := range toRun {\n\t\tlo.Printf(\"running migration %s\", m.version)\n\t\tif err := m.fn(db, fs, ko, lo); err != nil {\n\t\t\tlo.Fatalf(\"error running migration %s: %v\", m.version, err)\n\t\t}\n\n\t\t// Record the migration version in the settings table. There was no\n\t\t// settings table until v0.7.0, so ignore the no-table errors.\n\t\t// For nightly builds, skip recording so migrations re-run on each boot.\n\t\tif record {\n\t\t\tif err := recordMigrationVersion(m.version, db); err != nil {\n\t\t\t\tif isTableNotExistErr(err) {\n\t\t\t\t\tcontinue\n\t\t\t\t}\n\t\t\t\tlo.Fatalf(\"error recording migration version %s: %v\", m.version, err)\n\t\t\t}\n\t\t}\n\t}\n\n\tlo.Printf(\"upgrade complete\")\n}\n\n// checkUpgrade checks if the current database schema matches the expected\n// binary version.\nfunc checkUpgrade(db *sqlx.DB) {\n\tlastVer, toRun, err := getPendingMigrations(db)\n\tif err != nil {\n\t\tlo.Fatalf(\"error checking migrations: %v\", err)\n\t}\n\n\t// No migrations to run.\n\tif len(toRun) == 0 {\n\t\treturn\n\t}\n\n\tvar vers []string\n\tfor _, m := range toRun {\n\t\tvers = append(vers, m.version)\n\t}\n\n\tlo.Fatalf(`there are %d pending database upgrade(s): %v. The last upgrade was %s. Backup the database and run listmonk --upgrade`,\n\t\tlen(toRun), vers, lastVer)\n}\n\n// getPendingMigrations gets the pending migrations by comparing the last\n// recorded migration in the DB against all migrations listed in `migrations`.\nfunc getPendingMigrations(db *sqlx.DB) (string, []migFunc, error) {\n\tlastVer, err := getLastMigrationVersion(db)\n\tif err != nil {\n\t\treturn \"\", nil, err\n\t}\n\n\t// Iterate through the migration versions and get everything above the last\n\t// upgraded semver.\n\tvar toRun []migFunc\n\tfor i, m := range migList {\n\t\tif semver.Compare(m.version, lastVer) > 0 {\n\t\t\ttoRun = migList[i:]\n\t\t\tbreak\n\t\t}\n\t}\n\n\treturn lastVer, toRun, nil\n}\n\n// getLastMigrationVersion returns the last migration semver recorded in the DB.\n// If there isn't any, `v0.0.0` is returned.\nfunc getLastMigrationVersion(db *sqlx.DB) (string, error) {\n\tvar v string\n\tif err := db.Get(&v, `\n\t\tSELECT COALESCE(\n\t\t\t(SELECT value->>-1 FROM settings WHERE key='migrations'),\n\t\t'v0.0.0')`); err != nil {\n\t\tif isTableNotExistErr(err) {\n\t\t\treturn \"v0.0.0\", nil\n\t\t}\n\t\treturn v, err\n\t}\n\treturn v, nil\n}\n\n// isTableNotExistErr checks if the given error represents a Postgres/pq\n// \"table does not exist\" error.\nfunc isTableNotExistErr(err error) bool {\n\tif p, ok := err.(*pq.Error); ok {\n\t\t// `settings` table does not exist. It was introduced in v0.7.0.\n\t\tif p.Code == \"42P01\" {\n\t\t\treturn true\n\t\t}\n\t}\n\treturn false\n}\n" }, { "path": "cmd/users.go", "content": "package main\n\nimport (\n\t\"net/http\"\n\t\"regexp\"\n\t\"strings\"\n\n\t\"github.com/knadh/listmonk/internal/auth\"\n\t\"github.com/knadh/listmonk/internal/core\"\n\t\"github.com/knadh/listmonk/internal/utils\"\n\t\"github.com/knadh/listmonk/models\"\n\t\"github.com/labstack/echo/v4\"\n\t\"github.com/pquerna/otp/totp\"\n\t\"gopkg.in/volatiletech/null.v6\"\n)\n\nvar (\n\treUsername = regexp.MustCompile(`^[a-zA-Z0-9_\\-\\.@]+$`)\n)\n\n// GetUser retrieves a single user by ID.\nfunc (a *App) GetUser(c echo.Context) error {\n\t// Get the user from the DB.\n\tid := getID(c)\n\tout, err := a.core.GetUser(id, \"\", \"\")\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Blank out the password hash in the response.\n\tout.Password = null.String{}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// GetUsers retrieves all users.\nfunc (a *App) GetUsers(c echo.Context) error {\n\t// Get all users from the DB.\n\tout, err := a.core.GetUsers()\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Blank out the password hash in the response.\n\tfor n := range out {\n\t\tout[n].Password = null.String{}\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// CreateUser handles user creation.\nfunc (a *App) CreateUser(c echo.Context) error {\n\tvar u auth.User\n\tif err := c.Bind(&u); err != nil {\n\t\treturn err\n\t}\n\n\tu.Username = strings.TrimSpace(u.Username)\n\tu.Name = strings.TrimSpace(u.Name)\n\temail := strings.ToLower(strings.TrimSpace(u.Email.String))\n\n\t// Validate fields.\n\tif !strHasLen(u.Username, 3, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"username\"))\n\t}\n\tif !reUsername.MatchString(u.Username) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"username\"))\n\t}\n\tif u.Type != auth.UserTypeAPI {\n\t\tif !utils.ValidateEmail(email) {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"email\"))\n\t\t}\n\t\tif u.PasswordLogin {\n\t\t\tif !strHasLen(u.Password.String, 8, stdInputMaxLen) {\n\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t\t\t}\n\t\t}\n\n\t\tu.Email = null.String{String: email, Valid: true}\n\t}\n\n\tif u.Name == \"\" {\n\t\tu.Name = u.Username\n\t}\n\n\t// Create the user in the DB.\n\tuser, err := a.core.CreateUser(u)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Blank out the password hash in the response.\n\tif user.Type != auth.UserTypeAPI {\n\t\tuser.Password = null.String{}\n\t}\n\n\t// Cache the API token for in-memory, off-DB /api/* request auth.\n\tif _, err := cacheUsers(a.core, a.auth); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{user})\n}\n\n// UpdateUser handles user modification.\nfunc (a *App) UpdateUser(c echo.Context) error {\n\t// Incoming params.\n\tvar u auth.User\n\tif err := c.Bind(&u); err != nil {\n\t\treturn err\n\t}\n\n\tu.Username = strings.TrimSpace(u.Username)\n\tu.Name = strings.TrimSpace(u.Name)\n\temail := strings.ToLower(strings.TrimSpace(u.Email.String))\n\n\t// Validate fields.\n\tif !strHasLen(u.Username, 3, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"username\"))\n\t}\n\tif !reUsername.MatchString(u.Username) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"username\"))\n\t}\n\n\t// Get the user ID.\n\tid := getID(c)\n\tif u.Type != auth.UserTypeAPI {\n\t\tif !utils.ValidateEmail(email) {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"email\"))\n\t\t}\n\n\t\t// Validate password if password login is enabled.\n\t\tif u.PasswordLogin && u.Password.String != \"\" {\n\t\t\tif !strHasLen(u.Password.String, 8, stdInputMaxLen) {\n\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t\t\t}\n\n\t\t\tif u.Password.String != \"\" {\n\t\t\t\t// If a password is sent, validate it before updating in the DB. If it's not set, leave the password in the DB untouched.\n\t\t\t\tif !strHasLen(u.Password.String, 8, stdInputMaxLen) {\n\t\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t\t\t\t}\n\t\t\t} else {\n\t\t\t\t// Get the user from the DB.\n\t\t\t\tuser, err := a.core.GetUser(id, \"\", \"\")\n\t\t\t\tif err != nil {\n\t\t\t\t\treturn err\n\t\t\t\t}\n\n\t\t\t\t// If password login is enabled, but there's no password in the DB and there's no incoming\n\t\t\t\t// password, throw an error.\n\t\t\t\tif !user.HasPassword {\n\t\t\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t\t\t\t}\n\t\t\t}\n\t\t}\n\n\t\tu.Email = null.String{String: email, Valid: true}\n\t}\n\n\t// Default the name to username if not set.\n\tif u.Name == \"\" {\n\t\tu.Name = u.Username\n\t}\n\n\t// Update the user in the DB.\n\tuser, err := a.core.UpdateUser(id, u)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Blank out the password hash in the response.\n\tuser.Password = null.String{}\n\n\t// Cache the API token for in-memory, off-DB /api/* request auth.\n\tif _, err := cacheUsers(a.core, a.auth); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{user})\n}\n\n// DeleteUser handles the deletion of a single user by ID.\nfunc (a *App) DeleteUser(c echo.Context) error {\n\t// Delete the user(s) from the DB.\n\tid := getID(c)\n\tif err := a.core.DeleteUsers([]int{id}); err != nil {\n\t\treturn err\n\t}\n\n\t// Cache the API token for in-memory, off-DB /api/* request auth.\n\tif _, err := cacheUsers(a.core, a.auth); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DeleteUsers handles user deletion, either a single one (ID in the URI), or a list.\nfunc (a *App) DeleteUsers(c echo.Context) error {\n\tids, err := getQueryInts(\"id\", c.QueryParams())\n\tif err != nil {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidID\"))\n\t}\n\n\t// Delete the user(s) from the DB.\n\tif err := a.core.DeleteUsers(ids); err != nil {\n\t\treturn err\n\t}\n\n\t// Cache the API token for in-memory, off-DB /api/* request auth.\n\tif _, err := cacheUsers(a.core, a.auth); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// GetUserProfile fetches the uesr profile for the currently logged in user.\nfunc (a *App) GetUserProfile(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Blank out the password hash in the response.\n\tuser.Password.String = \"\"\n\tuser.Password.Valid = false\n\n\treturn c.JSON(http.StatusOK, okResp{user})\n}\n\n// UpdateUserProfile update's the current user's profile.\nfunc (a *App) UpdateUserProfile(c echo.Context) error {\n\t// Get the authenticated user.\n\tuser := auth.GetUser(c)\n\n\t// Incoming params.\n\tu := auth.User{}\n\tif err := c.Bind(&u); err != nil {\n\t\treturn err\n\t}\n\tu.PasswordLogin = user.PasswordLogin\n\tu.Name = strings.TrimSpace(u.Name)\n\temail := strings.TrimSpace(u.Email.String)\n\n\t// Validate fields.\n\tif user.PasswordLogin {\n\t\tif !utils.ValidateEmail(email) {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"email\"))\n\t\t}\n\t\tu.Email = null.String{String: email, Valid: true}\n\t}\n\n\tif u.PasswordLogin && u.Password.String != \"\" {\n\t\tif !strHasLen(u.Password.String, 8, stdInputMaxLen) {\n\t\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t\t}\n\t}\n\n\t// Update the user in the DB.\n\tout, err := a.core.UpdateUserProfile(user.ID, u)\n\tif err != nil {\n\t\treturn err\n\t}\n\n\t// Blank out the password hash in the response.\n\tout.Password = null.String{}\n\n\treturn c.JSON(http.StatusOK, okResp{out})\n}\n\n// EnableTOTP enables TOTP 2FA for a user after verifying the code.\nfunc (a *App) EnableTOTP(c echo.Context) error {\n\tvar (\n\t\tu = c.Get(auth.UserHTTPCtxKey).(auth.User)\n\t\tsecret = strings.TrimSpace(c.FormValue(\"secret\"))\n\t\tcode = strings.TrimSpace(c.FormValue(\"code\"))\n\t)\n\n\tif secret == \"\" || code == \"\" {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"globals.messages.invalidFields\"))\n\t}\n\n\t// If password login is disabled, can't enable TOTP.\n\tif !u.PasswordLogin {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"public.invalidFeature\"))\n\t}\n\n\t// If TOTP is already enabled, don't allow re-enabling.\n\tif u.TwofaType == models.TwofaTypeTOTP {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"users.twoFAAlreadyEnabled\"))\n\t}\n\n\t// Verify the TOTP code.\n\tvalid := totp.Validate(code, secret)\n\tif !valid {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"users.invalidTOTPCode\"))\n\t}\n\n\t// Enable TOTP in the DB.\n\tif err := a.core.SetTwoFA(u.ID, models.TwofaTypeTOTP, secret); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// DisableTOTP disables TOTP 2FA for a user after verifying the password.\nfunc (a *App) DisableTOTP(c echo.Context) error {\n\tvar (\n\t\tu = c.Get(auth.UserHTTPCtxKey).(auth.User)\n\t\tpassword = c.FormValue(\"password\")\n\t)\n\n\t// TOTP isn't enabled.\n\tif u.TwofaType != models.TwofaTypeTOTP {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.T(\"users.twoFANotEnabled\"))\n\t}\n\n\t// Validate password.\n\tif !strHasLen(password, 8, stdInputMaxLen) {\n\t\treturn echo.NewHTTPError(http.StatusBadRequest, a.i18n.Ts(\"globals.messages.invalidFields\", \"name\", \"password\"))\n\t}\n\n\t// Verify the password.\n\tif _, err := a.core.LoginUser(u.Username, password); err != nil {\n\t\treturn echo.NewHTTPError(http.StatusForbidden, a.i18n.T(\"users.invalidPassword\"))\n\t}\n\n\t// Disable TOTP in the DB.\n\tif err := a.core.SetTwoFA(u.ID, models.TwofaTypeNone, \"\"); err != nil {\n\t\treturn err\n\t}\n\n\treturn c.JSON(http.StatusOK, okResp{true})\n}\n\n// cacheUsers fetches (API) users and caches them in the auth module.\n// It also returns a bool indicating whether there are any actual users in the DB at all,\n// which if there aren't, the first time user setup needs to be run.\nfunc cacheUsers(co *core.Core, a *auth.Auth) (bool, error) {\n\tusers, err := co.GetUsers()\n\tif err != nil {\n\t\treturn false, err\n\t}\n\n\thasUser := false\n\tapiUsers := make([]auth.User, 0, len(users))\n\tfor _, u := range users {\n\t\tif u.Type == auth.UserTypeAPI && u.Status == auth.UserStatusEnabled {\n\t\t\tapiUsers = append(apiUsers, u)\n\t\t}\n\n\t\tif u.Type == auth.UserTypeUser {\n\t\t\thasUser = true\n\t\t}\n\t}\n\n\ta.CacheAPIUsers(apiUsers)\n\treturn hasUser, nil\n}\n" }, { "path": "cmd/utils.go", "content": "package main\n\nimport (\n\t\"crypto/rand\"\n\t\"fmt\"\n\t\"net/url\"\n\t\"path/filepath\"\n\t\"regexp\"\n\t\"slices\"\n\t\"strconv\"\n\t\"strings\"\n)\n\nvar (\n\tregexpSpaces = regexp.MustCompile(`[\\s]+`)\n)\n\n// inArray checks if a string is present in a list of strings.\nfunc inArray(val string, vals []string) (ok bool) {\n\treturn slices.Contains(vals, val)\n}\n\n// makeFilename sanitizes a filename (user supplied upload filenames).\nfunc makeFilename(fName string) string {\n\tname := strings.TrimSpace(fName)\n\tif name == \"\" {\n\t\tname, _ = generateRandomString(10)\n\t}\n\t// replace whitespace with \"-\"\n\tname = regexpSpaces.ReplaceAllString(name, \"-\")\n\treturn filepath.Base(name)\n}\n\n// appendSuffixToFilename adds a string suffix to the filename while keeping the file extension.\nfunc appendSuffixToFilename(filename, suffix string) string {\n\text := filepath.Ext(filename)\n\tname := strings.TrimSuffix(filename, ext)\n\treturn fmt.Sprintf(\"%s_%s%s\", name, suffix, ext)\n}\n\n// makeMsgTpl takes a page title, heading, and message and returns\n// a msgTpl that can be rendered as an HTML view. This is used for\n// rendering arbitrary HTML views with error and success messages.\nfunc makeMsgTpl(pageTitle, heading, msg string) msgTpl {\n\tif heading == \"\" {\n\t\theading = pageTitle\n\t}\n\terr := msgTpl{}\n\terr.Title = pageTitle\n\terr.MessageTitle = heading\n\terr.Message = msg\n\treturn err\n}\n\n// parseStringIDs takes a slice of numeric string IDs and\n// parses each number into an int64 and returns a slice of the\n// resultant values.\nfunc parseStringIDs(s []string) ([]int, error) {\n\tvals := make([]int, 0, len(s))\n\tfor _, v := range s {\n\t\ti, err := strconv.Atoi(v)\n\t\tif err != nil {\n\t\t\treturn nil, err\n\t\t}\n\n\t\tif i < 1 {\n\t\t\treturn nil, fmt.Errorf(\"%d is not a valid ID\", i)\n\t\t}\n\n\t\tvals = append(vals, i)\n\t}\n\n\treturn vals, nil\n}\n\n// generateRandomString generates a cryptographically random, alphanumeric string of length n.\nfunc generateRandomString(n int) (string, error) {\n\tconst dictionary = \"0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz\"\n\tvar bytes = make([]byte, n)\n\n\tif _, err := rand.Read(bytes); err != nil {\n\t\treturn \"\", err\n\t}\n\tfor k, v := range bytes {\n\t\tbytes[k] = dictionary[v%byte(len(dictionary))]\n\t}\n\n\treturn string(bytes), nil\n}\n\n// strHasLen checks if the given string has a length within min-max.\nfunc strHasLen(str string, min, max int) bool {\n\treturn len(str) >= min && len(str) <= max\n}\n\n// getQueryInts parses the list of given query param values into ints.\nfunc getQueryInts(param string, qp url.Values) ([]int, error) {\n\tvar out []int\n\tif vals, ok := qp[param]; ok {\n\t\tfor _, v := range vals {\n\t\t\tif v == \"\" {\n\t\t\t\tcontinue\n\t\t\t}\n\n\t\t\tlistID, err := strconv.Atoi(v)\n\t\t\tif err != nil {\n\t\t\t\treturn nil, err\n\t\t\t}\n\t\t\tout = append(out, listID)\n\t\t}\n\t}\n\n\treturn out, nil\n}\n" }, { "path": "config.toml.sample", "content": "[app]\n# Interface and port where the app will run its webserver. The default value\n# of localhost will only listen to connections from the current machine. To\n# listen on all interfaces use '0.0.0.0'. To listen on the default web address\n# port, use port 80 (this will require running with elevated permissions).\naddress = \"localhost:9000\"\n\n# Database.\n[db]\nhost = \"localhost\"\nport = 5432\nuser = \"listmonk\"\npassword = \"listmonk\"\n\n# Ensure that this database has been created in Postgres.\ndatabase = \"listmonk\"\n\nssl_mode = \"disable\"\nmax_open = 25\nmax_idle = 25\nmax_lifetime = \"300s\"\n\n# Optional space separated Postgres DSN params. eg: \"application_name=listmonk gssencmode=disable\"\nparams = \"\"\n" }, { "path": "dev/.gitignore", "content": "!config.toml\n" }, { "path": "dev/README.md", "content": "# Docker suite for development\n\n**NOTE**: This exists only for local development. If you're interested in using\nDocker for a production setup, visit the\n[docs](https://listmonk.app/docs/installation/#docker) instead.\n\n### Objective\n\nThe purpose of this Docker suite for local development is to isolate all the dev\ndependencies in a Docker environment. The containers have a host volume mounted\ninside for the entire app directory. This helps us to not do a full\n`docker build` for every single local change, only restarting the Docker\nenvironment is enough.\n\n## Setting up a dev suite\n\nTo spin up a local suite of:\n\n- PostgreSQL\n- Mailhog\n- Node.js frontend app\n- Golang backend app\n\n### Verify your config file\n\nThe config file provided at `dev/config.toml` will be used when running the\ncontainerized development stack. Make sure the values set within are suitable\nfor the feature you're trying to develop.\n\n### Setup DB\n\nRunning this will build the appropriate images and initialize the database.\n\n```bash\nmake init-dev-docker\n```\n\n### Start frontend and backend apps\n\nRunning this start your local development stack.\n\n```bash\nmake dev-docker\n```\n\nVisit `http://localhost:8080` on your browser.\n\n### Tear down\n\nThis will tear down all the data, including DB.\n\n```bash\nmake rm-dev-docker\n```\n\n### See local changes in action\n\n- Backend: Anytime you do a change to the Go app, it needs to be compiled. Just\n run `make dev-docker` again and that should automatically handle it for you.\n- Frontend: Anytime you change the frontend code, you don't need to do anything.\n Since `yarn` is watching for all the changes and we have mounted the code\n inside the docker container, `yarn` server automatically restarts.\n" }, { "path": "dev/app.Dockerfile", "content": "FROM golang:1.24.1 AS go\n\nFROM node:16 AS node\n\nCOPY --from=go /usr/local/go /usr/local/go\nENV GOPATH /go\nENV CGO_ENABLED=0\nENV PATH $GOPATH/bin:/usr/local/go/bin:$PATH\n\nWORKDIR /app\nCMD [ \"sleep infinity\" ]\n" }, { "path": "dev/config.toml", "content": "[app]\n# Interface and port where the app will run its webserver. The default value\n# of localhost will only listen to connections from the current machine. To\n# listen on all interfaces use '0.0.0.0'. To listen on the default web address\n# port, use port 80 (this will require running with elevated permissions).\naddress = \"0.0.0.0:9000\"\n\n# Database.\n[db]\nhost = \"db\"\nport = 5432\nuser = \"listmonk-dev\"\npassword = \"listmonk-dev\"\n\n# Ensure that this database has been created in Postgres.\ndatabase = \"listmonk-dev\"\n\nssl_mode = \"disable\"\nmax_open = 25\nmax_idle = 25\nmax_lifetime = \"300s\"\n\n# Optional space separated Postgres DSN params. eg: \"application_name=listmonk gssencmode=disable\"\nparams = \"\"\n" }, { "path": "dev/docker-compose.yml", "content": "version: \"3\"\n\nservices:\n adminer:\n image: adminer:4.8.1-standalone\n restart: always\n ports:\n - 8070:8080\n networks:\n - listmonk-dev\n\n mailhog:\n image: mailhog/mailhog:v1.0.1\n ports:\n - \"1025:1025\" # SMTP\n - \"8025:8025\" # UI\n networks:\n - listmonk-dev\n\n db:\n image: postgres:13\n ports:\n - \"5432:5432\"\n networks:\n - listmonk-dev\n environment:\n - POSTGRES_PASSWORD=listmonk-dev\n - POSTGRES_USER=listmonk-dev\n - POSTGRES_DB=listmonk-dev\n restart: unless-stopped\n volumes:\n - type: volume\n source: listmonk-dev-db\n target: /var/lib/postgresql/data\n\n front:\n build:\n context: ../\n dockerfile: dev/app.Dockerfile\n command: [\"make\", \"run-frontend\"]\n ports:\n - \"8080:8080\"\n environment:\n - LISTMONK_API_URL=http://backend:9000\n depends_on:\n - db\n volumes:\n - ../:/app\n networks:\n - listmonk-dev\n\n backend:\n build:\n context: ../\n dockerfile: dev/app.Dockerfile\n command: [\"make\", \"run-backend-docker\"]\n ports:\n - \"9000:9000\"\n depends_on:\n - db\n volumes:\n - ../:/app\n - $GOPATH/pkg/mod/cache:/go/pkg/mod/cache\n networks:\n - listmonk-dev\n\nvolumes:\n listmonk-dev-db:\n\nnetworks:\n listmonk-dev:\n" }, { "path": "docker-compose.yml", "content": "# All LISTMONK_* env variables also support the LISTMONK_*_FILE pattern for loading secrets from files with Docker secrets and Podman\n# eg: LISTMONK_ADMIN_USER -> LISTMONK_ADMIN_USER_FILE=/path/to/file_with_value\n\nx-db-credentials: &db-credentials # Use the default POSTGRES_ credentials if they're available or simply default to \"listmonk\"\n POSTGRES_USER: &db-user listmonk # for database user, password, and database name\n POSTGRES_PASSWORD: &db-password listmonk\n POSTGRES_DB: &db-name listmonk\n\nservices:\n # listmonk app\n app:\n image: listmonk/listmonk:latest\n container_name: listmonk_app\n restart: unless-stopped\n ports:\n - \"9000:9000\" # To change the externally exposed port, change to: $custom_port:9000\n networks:\n - listmonk\n hostname: listmonk.example.com # Recommend using FQDN for hostname\n depends_on:\n - db\n command: [sh, -c, \"./listmonk --install --idempotent --yes --config '' && ./listmonk --upgrade --yes --config '' && ./listmonk --config ''\"]\n # --config (file) param is set to empty so that listmonk only uses the env vars (below) for config.\n # --install --idempotent ensures that DB installation happens only once on an empty DB, on the first ever start.\n # --upgrade automatically runs any DB migrations when a new image is pulled.\n\n environment: # The same params as in config.toml are passed as env vars here.\n LISTMONK_app__address: 0.0.0.0:9000\n LISTMONK_db__user: *db-user\n LISTMONK_db__password: *db-password\n LISTMONK_db__database: *db-name\n LISTMONK_db__host: db\n LISTMONK_db__port: 5432\n LISTMONK_db__ssl_mode: disable\n LISTMONK_db__max_open: 25\n LISTMONK_db__max_idle: 25\n LISTMONK_db__max_lifetime: 300s\n TZ: Etc/UTC\n LISTMONK_ADMIN_USER: ${LISTMONK_ADMIN_USER:-} # If these (optional) are set during the first `docker compose up`, then the Super Admin user is automatically created.\n LISTMONK_ADMIN_PASSWORD: ${LISTMONK_ADMIN_PASSWORD:-} # Otherwise, the user can be setup on the web app after the first visit to http://localhost:9000\n volumes:\n - ./uploads:/listmonk/uploads:rw # Mount an uploads directory on the host to /listmonk/uploads inside the container.\n # To use this, change directory path in Admin -> Settings -> Media to /listmonk/uploads\n\n # Postgres database\n db:\n image: postgres:17-alpine\n container_name: listmonk_db\n restart: unless-stopped\n ports:\n - \"127.0.0.1:5432:5432\" # Only bind on the local interface. To connect to Postgres externally, change this to 0.0.0.0\n networks:\n - listmonk\n environment:\n <<: *db-credentials\n healthcheck:\n test: [\"CMD-SHELL\", \"pg_isready -U listmonk\"]\n interval: 10s\n timeout: 5s\n retries: 6\n volumes:\n - type: volume\n source: listmonk-data\n target: /var/lib/postgresql/data\n\nnetworks:\n listmonk:\n\nvolumes:\n listmonk-data:\n" }, { "path": "docker-entrypoint.sh", "content": "#!/bin/sh\n\nset -e\n\nexport PUID=${PUID:-0}\nexport PGID=${PGID:-0}\nexport GROUP_NAME=\"app\"\nexport USER_NAME=\"app\"\n\n# This function evaluates if the supplied PGID is already in use\n# if it is not in use, it creates the group with the PGID\n# if it is in use, it sets the GROUP_NAME to the existing group\ncreate_group() {\n if ! getent group ${PGID} > /dev/null 2>&1; then\n addgroup -g ${PGID} ${GROUP_NAME}\n else\n existing_group=$(getent group ${PGID} | cut -d: -f1)\n export GROUP_NAME=${existing_group}\n fi\n}\n\n# This function evaluates if the supplied PUID is already in use\n# if it is not in use, it creates the user with the PUID and PGID\ncreate_user() {\n if ! getent passwd ${PUID} > /dev/null 2>&1; then\n adduser -u ${PUID} -G ${GROUP_NAME} -s /bin/sh -D ${USER_NAME}\n else\n existing_user=$(getent passwd ${PUID} | cut -d: -f1)\n export USER_NAME=${existing_user}\n fi\n}\n\n# Run the needed functions to create the user and group\ncreate_group\ncreate_user\n\nload_secret_files() {\n # Save and restore IFS\n old_ifs=\"$IFS\"\n IFS='\n'\n # Capture all env variables starting with LISTMONK_ and ending with _FILE.\n # It's value is assumed to be a file path with its actual value.\n for line in $(env | grep '^LISTMONK_.*_FILE='); do\n var=\"${line%%=*}\"\n fpath=\"${line#*=}\"\n\n # If it's a valid file, read its contents and assign it to the var\n # without the _FILE suffix.\n # Eg: LISTMONK_DB_USER_FILE=/run/secrets/user -> LISTMONK_DB_USER=$(contents of /run/secrets/user)\n if [ -f \"$fpath\" ]; then\n new_var=\"${var%_FILE}\"\n export \"$new_var\"=\"$(cat \"$fpath\")\"\n fi\n done\n IFS=\"$old_ifs\"\n}\n\n# Load env variables from files if LISTMONK_*_FILE variables are set.\nload_secret_files\n\n# Try to set the ownership of the app directory to the app user.\nif ! chown -R ${PUID}:${PGID} /listmonk 2>/dev/null; then\n echo \"Warning: Failed to change ownership of /listmonk. Readonly volume?\"\nfi\n\necho \"Launching listmonk with user=[${USER_NAME}] group=[${GROUP_NAME}] PUID=[${PUID}] PGID=[${PGID}]\"\n\n# If running as root and PUID is not 0, then execute command as PUID\n# this allows us to run the container as a non-root user\nif [ \"$(id -u)\" = \"0\" ] && [ \"${PUID}\" != \"0\" ]; then\n su-exec ${PUID}:${PGID} \"$@\"\nelse\n exec \"$@\"\nfi\n" }, { "path": "docs/README.md", "content": "# Static website and docs\n\nThis repository contains the source for the static website https://listmonk.app\n\n- The website is in `site` and is built with hugo (run `hugo serve` inside `site` to preview).\n\n- Documentation is in `docs` and is built with mkdocs (inside `docs`, run `mkdocs serve` to preview after running `pip install -r requirements.txt`)\n\n- `i18n` directory has the static UI for i18n translations: https://listmonk.app/i18n\n" }, { "path": "docs/docs/content/apis/apis.md", "content": "# APIs\n\nAll features that are available on the listmonk dashboard are also available as REST-like HTTP APIs that can be interacted with directly. Request and response bodies are JSON. This allows easy scripting of listmonk and integration with other systems, for instance, synchronisation with external subscriber databases.\n\n!!! note\n If you come across API calls that are yet to be documented, please consider contributing to docs.\n\n\n## Auth\nHTTP API requests support BasicAuth and a Authorization `token` headers. API users and tokens with the required permissions can be created and managed on the admin UI (Admin -> Users).\n\n##### BasicAuth example\n```shell\ncurl -u \"api_user:token\" http://localhost:9000/api/lists\n```\n\n##### Authorization token example\n```shell\ncurl -H \"Authorization: token api_user:token\" http://localhost:9000/api/lists\n```\n\n## Permissions\n**User role**: Permissions allowed for a user are defined as a *User role* (Admin -> User roles) and then attached to a user. \n\n**List role**: Read / write permissions per-list can be defined as a *List role* (Admin -> User roles) and then attached to a user. \n\nIn a *User role*, `lists:get_all` or `lists:manage_all` permission supercede and override any list specific permissions for a user defined in a *List role*.\n\nTo manage lists and subscriber list subscriptions via API requests, ensure that the appropriate permissions are attached to the API user.\n\n______________________________________________________________________\n\n## Response structure\n\n### Successful request\n\n```http\nHTTP/1.1 200 OK\nContent-Type: application/json\n\n{\n \"data\": {}\n}\n```\n\nAll responses from the API server are JSON with the content-type application/json unless explicitly stated otherwise. A successful 200 OK response always has a JSON response body with a status key with the value success. The data key contains the full response payload.\n\n### Failed request\n\n```http\nHTTP/1.1 500 Server error\nContent-Type: application/json\n\n{\n \"message\": \"Error message\"\n}\n```\n\nA failure response is preceded by the corresponding 40x or 50x HTTP header. There may be an optional `data` key with additional payload.\n\n### Timestamps\n\nAll timestamp fields are in the format `2019-01-01T09:00:00.000000+05:30`. The seconds component is suffixed by the milliseconds, followed by the `+` and the timezone offset.\n\n### Common HTTP error codes\n\n| Code | |\n| ----- | ----------------------------------------------------------------------------|\n| 400 | Missing or bad request parameters or values |\n| 403 | Session expired or invalidate. Must relogin |\n| 404 | Request resource was not found |\n| 405 | Request method (GET, POST etc.) is not allowed on the requested endpoint |\n| 410 | The requested resource is gone permanently |\n| 422 | Unprocessable entity. Unable to process request as it contains invalid data |\n| 429 | Too many requests to the API (rate limiting) |\n| 500 | Something unexpected went wrong |\n| 502 | The backend OMS is down and the API is unable to communicate with it |\n| 503 | Service unavailable; the API is down |\n| 504 | Gateway timeout; the API is unreachable |\n\n\n## OpenAPI (Swagger) spec\n\nThe auto-generated OpenAPI (Swagger) specification site for the APIs are available at [**listmonk.app/docs/swagger**](https://listmonk.app/docs/swagger/)\n\n" }, { "path": "docs/docs/content/apis/bounces.md", "content": "# API / Bounces\n\nMethod | Endpoint | Description\n---------|---------------------------------------------------------|------------------------------------------------\nGET | [/api/bounces](#get-apibounces) | Retrieve bounce records.\nDELETE | [/api/bounces](#delete-apibounces) | Delete all/multiple bounce records.\nDELETE | [/api/bounces/{bounce_id}](#delete-apibouncesbounce_id) | Delete specific bounce record.\n\n\n______________________________________________________________________\n\n#### GET /api/bounces\n\nRetrieve the bounce records.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:-----------|:---------|:---------|:-----------------------------------------------------------------|\n| campaign_id| number | | Bounce record retrieval for particular campaign id |\n| page | number | | Page number for pagination. |\n| per_page | number | | Results per page. Set to 'all' to return all results. |\n| source | string | | |\n| order_by | string | | Fields by which bounce records are ordered. Options:\"email\", \"campaign_name\", \"source\", \"created_at\". |\n| order | number | | Sorts the result. Allowed values: 'asc','desc' |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/bounces?campaign_id=1&page=1&per_page=2' \\ \n -H 'accept: application/json' -H 'Content-Type: application/x-www-form-urlencoded' \\\n --data '{\"source\":\"demo\",\"order_by\":\"created_at\",\"order\":\"asc\"}'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"results\": [\n {\n \"id\": 839971,\n \"type\": \"hard\",\n \"source\": \"demo\",\n \"meta\": {\n \"some\": \"parameter\"\n },\n \"created_at\": \"2024-08-20T23:54:22.851858Z\",\n \"email\": \"gilles.deleuze@example.app\",\n \"subscriber_uuid\": \"32ca1f3e-1a1d-42e1-af04-df0757f420f3\",\n \"subscriber_id\": 60,\n \"campaign\": {\n \"id\": 1,\n \"name\": \"Test campaign\"\n }\n },\n {\n \"id\": 839725,\n \"type\": \"hard\",\n \"source\": \"demo\",\n \"meta\": {\n \"some\": \"parameter\"\n },\n \"created_at\": \"2024-08-20T22:46:36.393547Z\",\n \"email\": \"gottfried.leibniz@example.app\",\n \"subscriber_uuid\": \"5911d3f4-2346-4bfc-aad2-eb319ab0e879\",\n \"subscriber_id\": 13,\n \"campaign\": {\n \"id\": 1,\n \"name\": \"Test campaign\"\n }\n }\n ],\n \"query\": \"\",\n \"total\": 528,\n \"per_page\": 2,\n \"page\": 1\n }\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/bounces\n\nTo delete all bounces.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:--------|:----------|:---------|:-------------------------------------|\n| all | bool | Yes | Bool to confirm deleting all bounces |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X DELETE 'http://localhost:9000/api/bounces?all=true'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/bounces\n\nTo delete multiple bounce records.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:--------|:----------|:---------|:-------------------------------------|\n| id | number | Yes | Id's of bounce records to delete. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X DELETE 'http://localhost:9000/api/bounces?id=840965&id=840168&id=840879'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/bounces/{bounce_id}\n\nTo delete specific bounce id.\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X DELETE 'http://localhost:9000/api/bounces/840965'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```" }, { "path": "docs/docs/content/apis/campaigns.md", "content": "# API / Campaigns\n\n| Method | Endpoint | Description |\n| :----- | :-------------------------------------------------------------------------- | :---------------------------------------- |\n| GET | [/api/campaigns](#get-apicampaigns) | Retrieve all campaigns. |\n| GET | [/api/campaigns/{campaign_id}](#get-apicampaignscampaign_id) | Retrieve a specific campaign. |\n| GET | [/api/campaigns/{campaign_id}/preview](#get-apicampaignscampaign_idpreview) | Retrieve preview of a campaign. |\n| GET | [/api/campaigns/running/stats](#get-apicampaignsrunningstats) | Retrieve stats of specified campaigns. |\n| GET | [/api/campaigns/analytics/{type}](#get-apicampaignsanalyticstype) | Retrieve view counts for a campaign. |\n| POST | [/api/campaigns](#post-apicampaigns) | Create a new campaign. |\n| POST | [/api/campaigns/{campaign_id}/test](#post-apicampaignscampaign_idtest) | Test campaign with arbitrary subscribers. |\n| PUT | [/api/campaigns/{campaign_id}](#put-apicampaignscampaign_id) | Update a campaign. |\n| PUT | [/api/campaigns/{campaign_id}/status](#put-apicampaignscampaign_idstatus) | Change status of a campaign. |\n| PUT | [/api/campaigns/{campaign_id}/archive](#put-apicampaignscampaign_idarchive) | Publish campaign to public archive. |\n| DELETE | [/api/campaigns/{campaign_id}](#delete-apicampaignscampaign_id) | Delete a campaign. |\n| DELETE | [/api/campaigns](#delete-apicampaigns) | Delete multiple campaigns. |\n\n____________________________________________________________________________________________________________________________________\n\n#### GET /api/campaigns\n\nRetrieve all campaigns.\n\n##### Example Request\n\n```shell\n curl -u \"api_user:token\" -X GET 'http://localhost:9000/api/campaigns?page=1&per_page=100'\n```\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------- | :------- | :------- | :----------------------------------------------------------------------- |\n| order | string | | Sorting order: ASC for ascending, DESC for descending. |\n| order_by | string | | Result sorting field. Options: name, status, created_at, updated_at. |\n| query | string | | String to filtter by campaign name and subject (fulltext and substring). |\n| status | []string | | Status to filter campaigns. Repeat in the query for multiple values. |\n| tags | []string | | Tags to filter campaigns. Repeat in the query for multiple values. |\n| page | number | | Page number for paginated results. |\n| per_page | number | | Results per page. Set as 'all' for all results. |\n| no_body | boolean | | When set to true, returns response without body content. |\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"results\": [\n {\n \"id\": 1,\n \"created_at\": \"2020-03-14T17:36:41.29451+01:00\",\n \"updated_at\": \"2020-03-14T17:36:41.29451+01:00\",\n \"views\": 0,\n \"clicks\": 0,\n \"lists\": [\n {\n \"id\": 1,\n \"name\": \"Default list\"\n }\n ],\n \"started_at\": null,\n \"to_send\": 0,\n \"sent\": 0,\n \"uuid\": \"57702beb-6fae-4355-a324-c2fd5b59a549\",\n \"type\": \"regular\",\n \"name\": \"Test campaign\",\n \"subject\": \"Welcome to listmonk\",\n \"from_email\": \"No ReplyHi {{ .Subscriber.FirstName }}!
\\n\\t\\t\\tThis is a test e-mail campaign. Your second name is {{ .Subscriber.LastName }} and you are from {{ .Subscriber.Attribs.city }}.\",\n \"body_source\": null,\n \"send_at\": \"2020-03-15T17:36:41.293233+01:00\",\n \"status\": \"draft\",\n \"content_type\": \"richtext\",\n \"tags\": [\n \"test-campaign\"\n ],\n \"template_id\": 1,\n \"messenger\": \"email\"\n }\n ],\n \"query\": \"\",\n \"total\": 1,\n \"per_page\": 20,\n \"page\": 1\n }\n}\n```\n\n______________________________________________________________________\n\n#### GET /api/campaigns/{campaign_id}\n\nRetrieve a specific campaign.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---------- | :------ | :------- | :------------------------------------------------------- |\n| campaign_id | number | Yes | Campaign ID. |\n| no_body | boolean | | When set to true, returns response without body content. |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/campaigns/1'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 1,\n \"created_at\": \"2020-03-14T17:36:41.29451+01:00\",\n \"updated_at\": \"2020-03-14T17:36:41.29451+01:00\",\n \"views\": 0,\n \"clicks\": 0,\n \"lists\": [\n {\n \"id\": 1,\n \"name\": \"Default list\"\n }\n ],\n \"started_at\": null,\n \"to_send\": 0,\n \"sent\": 0,\n \"uuid\": \"57702beb-6fae-4355-a324-c2fd5b59a549\",\n \"type\": \"regular\",\n \"name\": \"Test campaign\",\n \"subject\": \"Welcome to listmonk\",\n \"from_email\": \"No ReplyHi {{ .Subscriber.FirstName }}!
\\n\\t\\t\\tThis is a test e-mail campaign. Your second name is {{ .Subscriber.LastName }} and you are from {{ .Subscriber.Attribs.city }}.\",\n \"body_source\": null,\n \"send_at\": \"2020-03-15T17:36:41.293233+01:00\",\n \"status\": \"draft\",\n \"content_type\": \"richtext\",\n \"tags\": [\n \"test-campaign\"\n ],\n \"template_id\": 1,\n \"messenger\": \"email\"\n }\n}\n```\n\n______________________________________________________________________\n\n#### GET /api/campaigns/{campaign_id}/preview\n\nPreview a specific campaign.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---------- | :----- | :------- | :---------------------- |\n| campaign_id | number | Yes | Campaign ID to preview. |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/campaigns/1/preview'\n```\n\n##### Example Response\n\n```html\nHi John!
\nThis is a test e-mail campaign. Your second name is Doe and you are from Bengaluru.\n```\n\n______________________________________________________________________\n\n#### GET /api/campaigns/running/stats\n\nRetrieve stats of specified campaigns.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---------- | :----- | :------- | :----------------------------- |\n| campaign_id | number | Yes | Campaign IDs to get stats for. |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/campaigns/running/stats?campaign_id=1'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": []\n}\n```\n\n______________________________________________________________________\n\n#### GET /api/campaigns/analytics/{type}\n\nRetrieve stats of specified campaigns.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :--- | :--------- | :------- | :-------------------------------------------- |\n| id | number\\[\\] | Yes | Campaign IDs to get stats for. |\n| type | string | Yes | Analytics type: views, links, clicks, bounces |\n| from | string | Yes | Start value of date range. |\n| to | string | Yes | End value of date range. |\n\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/campaigns/analytics/views?id=1&from=2024-08-04&to=2024-08-12'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": [\n {\n \"campaign_id\": 1,\n \"count\": 10,\n \"timestamp\": \"2024-08-04T00:00:00Z\"\n },\n {\n \"campaign_id\": 1,\n \"count\": 14,\n \"timestamp\": \"2024-08-08T00:00:00Z\"\n },\n {\n \"campaign_id\": 1,\n \"count\": 20,\n \"timestamp\": \"2024-08-09T00:00:00Z\"\n },\n {\n \"campaign_id\": 1,\n \"count\": 21,\n \"timestamp\": \"2024-08-10T00:00:00Z\"\n },\n {\n \"campaign_id\": 1,\n \"count\": 21,\n \"timestamp\": \"2024-08-11T00:00:00Z\"\n }\n ]\n}\n```\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/campaigns/analytics/links?id=1&from=2024-08-04T18%3A30%3A00.624Z&to=2024-08-12T18%3A29%3A00.624Z'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": [\n {\n \"url\": \"https://freethebears.org\",\n \"count\": 294\n },\n {\n \"url\": \"https://calmcode.io\",\n \"count\": 278\n },\n {\n \"url\": \"https://climate.nasa.gov\",\n \"count\": 261\n },\n {\n \"url\": \"https://www.storybreathing.com\",\n \"count\": 260\n }\n ]\n}\n```\n\n______________________________________________________________________\n\n#### POST /api/campaigns\n\nCreate a new campaign.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :----------- | :--------- | :------- | :--------------------------------------------------------------------------------------------------------------------- |\n| name | string | Yes | Campaign name. |\n| subject | string | Yes | Campaign email subject. |\n| lists | number\\[\\] | Yes | List IDs to send campaign to. |\n| from_email | string | | 'From' email in campaign emails. Defaults to value from settings if not provided. |\n| type | string | Yes | Campaign type: 'regular' or 'optin'. |\n| content_type | string | Yes | Content type: 'richtext', 'html', 'markdown', 'plain', 'visual'. |\n| body | string | Yes | Content body of campaign. |\n| body_source | string | | If content_type is `visual`, the JSON block source of the body. |\n| altbody | string | | Alternate plain text body for HTML (and richtext) emails. |\n| send_at | string | | Timestamp to schedule campaign. Format: 'YYYY-MM-DDTHH:MM:SSZ'. |\n| messenger | string | | 'email' or a custom messenger defined in settings. Defaults to 'email' if not provided. |\n| template_id | number | | Template ID to use. Defaults to default template if not provided. |\n| tags | string\\[\\] | | Tags to mark campaign. |\n| headers | JSON | | Key-value pairs to send as SMTP headers. Example: \\[{\"x-custom-header\": \"value\"}\\]. |\n| attribs | JSON | | Optional JSON object attributes that can be used in the campaign message template. Example `{\"location\": \"Somewhere\"}` |\n\n##### Example request\n\n```shell\ncurl -u \"api_user:token\" 'http://localhost:9000/api/campaigns' -X POST -H 'Content-Type: application/json;charset=utf-8' --data-raw '{\"name\":\"Test campaign\",\"subject\":\"Hello, world\",\"lists\":[1],\"from_email\":\"listmonkHi {{ .Subscriber.FirstName }}!
\\n\\t\\t\\tThis is a test e-mail campaign. Your second name is {{ .Subscriber.LastName }} and you are from {{ .Subscriber.Attribs.city }}.\",\n \"send_at\": \"2020-03-15T17:36:41.293233+01:00\",\n \"status\": \"scheduled\",\n \"content_type\": \"richtext\",\n \"tags\": [\n \"test-campaign\"\n ],\n \"template_id\": 1,\n \"messenger\": \"email\"\n }\n}\n```\n\n______________________________________________________________________\n\n#### PUT /api/campaigns/{campaign_id}/archive\n\nPublish campaign to public archive.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------------------ | :---------- | :------- | :------------------------------------------------------------------------ |\n| campaign_id | number | Yes | Campaign ID to publish to public archive. |\n| archive | bool | Yes | State of the public archive. |\n| archive_template_id | number | No | Archive template id. Defaults to 0. |\n| archive_meta | JSON string | No | Optional Metadata to use in campaign message or template.Eg: name, email. |\n| archive_slug | string | No | Name for page to be used in public archive URL |\n\n\n##### Example Request\n\n```shell\n\ncurl -u \"api_user:token\" -X PUT 'http://localhost:8080/api/campaigns/33/archive' \n--header 'Content-Type: application/json' \n--data-raw '{\"archive\":true,\"archive_template_id\":1,\"archive_meta\":{},\"archive_slug\":\"my-newsletter-old-edition\"}'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"archive\": true,\n \"archive_template_id\": 1,\n \"archive_meta\": {},\n \"archive_slug\": \"my-newsletter-old-edition\"\n }\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/campaigns/{campaign_id}\n\nDelete a campaign.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---------- | :----- | :------- | :--------------------- |\n| campaign_id | number | Yes | Campaign ID to delete. |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X DELETE 'http://localhost:9000/api/campaigns/34'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/campaigns\n\nDelete multiple campaigns by IDs or by a search query.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---- | :--------- | :---------------------------- | :-------------------------------------------------------------------------- |\n| id | number\\[\\] | Yes (if `query` not provided) | Onr or more campaign IDs to delete. |\n| query | string | Yes (if `id` not provided) | Fulltext search query to filter campaigns for deletion (same as GET query). |\n\n##### Example Request (by IDs)\n\n```shell\ncurl -u \"api_user:token\" -X DELETE 'http://localhost:9000/api/campaigns?id=10&id=11&id=12'\n```\n\n##### Example Request (by search query)\n\n```shell\ncurl -u \"api_user:token\" -X DELETE 'http://localhost:9000/api/campaigns?query=test%20campaign'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n" }, { "path": "docs/docs/content/apis/import.md", "content": "# API / Import\n\nMethod | Endpoint | Description\n---------|-------------------------------------------------|------------------------------------------------\nGET | [/api/import/subscribers](#get-apiimportsubscribers) | Retrieve import statistics.\nGET | [/api/import/subscribers/logs](#get-apiimportsubscriberslogs) | Retrieve import logs.\nPOST | [/api/import/subscribers](#post-apiimportsubscribers) | Upload a file for bulk subscriber import.\nDELETE | [/api/import/subscribers](#delete-apiimportsubscribers) | Stop and remove an import.\n\n______________________________________________________________________\n\n#### GET /api/import/subscribers\n\nRetrieve the status of an ongoing import.\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/import/subscribers'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"name\": \"\",\n \"total\": 0,\n \"imported\": 0,\n \"status\": \"none\"\n }\n}\n```\n\n______________________________________________________________________\n\n#### GET /api/import/subscribers/logs\n\nRetrieve logs from an ongoing import.\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/import/subscribers/logs'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": \"2020/04/08 21:55:20 processing 'import.csv'\\n2020/04/08 21:55:21 imported finished\\n\"\n}\n```\n\n______________________________________________________________________\n\n#### POST /api/import/subscribers\n\nSend a CSV (optionally ZIP compressed) file to import subscribers. Use a multipart form POST.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:-------|:------------|:---------|:-----------------------------------------|\n| params | JSON string | Yes | Stringified JSON with import parameters. |\n| file | file | Yes | File for upload. |\n\n\n#### `params` (JSON string)\n| Name | Type | Required | Description |\n|:----------|:---------|:---------|:-----------------------------------------------------------------------------------------------------------------------------------|\n| mode | string | Yes | `subscribe` or `blocklist` |\n| delim | string | Yes | Single character indicating delimiter used in the CSV file, eg: `,` |\n| lists | []number | | Array of list IDs to subscribe to. |\n| overwrite | bool | | Whether to overwrite the subscriber parameters including subscriptions or ignore records that are already present in the database. |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X POST 'http://localhost:9000/api/import/subscribers' \\\n -F 'params={\"mode\":\"subscribe\", \"subscription_status\":\"confirmed\", \"delim\":\",\", \"lists\":[1, 2], \"overwrite\": true}' \\\n -F \"file=@/path/to/subs.csv\"\n```\n\n##### Example Response\n\n```json\n {\n \"mode\": \"subscribe\", // subscribe or blocklist\n \"delim\": \",\", // delimiter in the uploaded file\n \"lists\":[1], // array of list IDs to import into\n \"overwrite\": true // overwrite existing entries or skip them?\n }\n```\n\n______________________________________________________________________\n\n#### DELETE /api/import/subscribers\n\nStop and delete an ongoing import.\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X DELETE 'http://localhost:9000/api/import/subscribers' \n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"name\": \"\",\n \"total\": 0,\n \"imported\": 0,\n \"status\": \"none\"\n }\n}\n```\n" }, { "path": "docs/docs/content/apis/lists.md", "content": "# API / Lists\n\n| Method | Endpoint | Description |\n| :----- | :---------------------------------------------- | :------------------------ |\n| GET | [/api/lists](#get-apilists) | Retrieve all lists. |\n| GET | [/api/public/lists](#get-public-apilists) | Retrieve public lists. |\n| GET | [/api/lists/{list_id}](#get-apilistslist_id) | Retrieve a specific list. |\n| POST | [/api/lists](#post-apilists) | Create a new list. |\n| PUT | [/api/lists/{list_id}](#put-apilistslist_id) | Update a list. |\n| DELETE | [/api/lists/{list_id}](#delete-apilistslist_id) | Delete a list. |\n| DELETE | [/api/lists](#delete-apilists) | Delete multiple lists. |\n\n______________________________________________________________________\n\n#### GET /api/lists\n\nRetrieve lists.\n\n> **Note:** Lists with `status: archived` are hidden from list selectors in campaigns, public subscription forms, and roles by default. They can only be viewed by filtering with `status=archived` or by viewing all lists without a status filter.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------- | :------- | :------- | :------------------------------------------------------------------------------------------------- |\n| query | string | | String for list name search. |\n| status | string | | Status to filter lists. Options: active, archived. Defaults to showing all lists if not specified. |\n| minimal | boolean | | If true, returns lists without subscriber counts (faster). Defaults to false. |\n| tag | []string | | Tags to filter lists. Repeat in the query for multiple values. |\n| order_by | string | | Sort field. Options: name, status, created_at, updated_at. |\n| order | string | | Sorting order. Options: ASC, DESC. |\n| page | number | | Page number for pagination. |\n| per_page | number | | Results per page. Set to 'all' to return all results. |\n\n##### Example Request\n\n```shell\n# Get all lists\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/lists?page=1&per_page=100'\n\n# Get only active lists\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/lists?status=active&per_page=100'\n\n# Get archived lists with minimal data\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/lists?status=archived&minimal=true&per_page=all'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"results\": [\n {\n \"id\": 1,\n \"created_at\": \"2020-02-10T23:07:16.194843+01:00\",\n \"updated_at\": \"2020-03-06T22:32:01.118327+01:00\",\n \"uuid\": \"ce13e971-c2ed-4069-bd0c-240e9a9f56f9\",\n \"name\": \"Default list\",\n \"type\": \"public\",\n \"optin\": \"double\",\n \"status\": \"active\",\n \"tags\": [\n \"test\"\n ],\n \"subscriber_count\": 2\n },\n {\n \"id\": 2,\n \"created_at\": \"2020-03-04T21:12:09.555013+01:00\",\n \"updated_at\": \"2020-03-06T22:34:46.405031+01:00\",\n \"uuid\": \"f20a2308-dfb5-4420-a56d-ecf0618a102d\",\n \"name\": \"get\",\n \"type\": \"private\",\n \"optin\": \"single\",\n \"status\": \"active\",\n \"tags\": [],\n \"subscriber_count\": 0\n }\n ],\n \"total\": 5,\n \"per_page\": 20,\n \"page\": 1\n }\n}\n```\n\n______________________________________________________________________\n\n#### GET /api/public/lists\n\nRetrieve public lists with name and uuid to submit a subscription. This is an unauthenticated call to enable scripting to subscription form.\n\n> **Note:** This endpoint only returns lists with `type: public` and `status: active`. Archived lists are never shown on public subscription forms.\n\n##### Example Request\n\n```shell\ncurl -X GET 'http://localhost:9000/api/public/lists'\n```\n\n##### Example Response\n\n```json\n[\n {\n \"uuid\": \"55e243af-80c6-4169-8d7f-bc571e0269e9\",\n \"name\": \"Opt-in list\"\n }\n]\n```\n______________________________________________________________________\n\n#### GET /api/lists/{list_id}\n\nRetrieve a specific list.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------ | :----- | :------- | :-------------------------- |\n| list_id | number | Yes | ID of the list to retrieve. |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/lists/5'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 5,\n \"created_at\": \"2020-03-07T06:31:06.072483+01:00\",\n \"updated_at\": \"2020-03-07T06:31:06.072483+01:00\",\n \"uuid\": \"1bb246ab-7417-4cef-bddc-8fc8fc941d3a\",\n \"name\": \"Test list\",\n \"type\": \"public\",\n \"optin\": \"double\",\n \"status\": \"active\",\n \"tags\": [],\n \"subscriber_count\": 0\n }\n}\n```\n\n______________________________________________________________________\n\n#### POST /api/lists\n\nCreate a new list.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---------- | :--------- | :------- | :----------------------------------------------------------------- |\n| name | string | Yes | Name of the new list. |\n| type | string | Yes | Type of list. Options: private, public. |\n| optin | string | Yes | Opt-in type. Options: single, double. |\n| status | string | No | Status of the list. Options: active, archived. Defaults to active. |\n| tags | string\\[\\] | | Associated tags for a list. |\n| description | string | No | Description of the new list. |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X POST 'http://localhost:9000/api/lists'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 5,\n \"created_at\": \"2020-03-07T06:31:06.072483+01:00\",\n \"updated_at\": \"2020-03-07T06:31:06.072483+01:00\",\n \"uuid\": \"1bb246ab-7417-4cef-bddc-8fc8fc941d3a\",\n \"name\": \"Test list\",\n \"type\": \"public\",\n \"optin\": \"single\",\n \"status\": \"active\",\n \"tags\": [],\n \"subscriber_count\": 0,\n \"description\": \"This is a test list\"\n }\n}\n```\n\n______________________________________________________________________\n\n#### PUT /api/lists/{list_id}\n\nUpdate a list.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---------- | :--------- | :------- | :--------------------------------------------- |\n| list_id | number | Yes | ID of the list to update. |\n| name | string | | New name for the list. |\n| type | string | | Type of list. Options: private, public. |\n| optin | string | | Opt-in type. Options: single, double. |\n| status | string | | Status of the list. Options: active, archived. |\n| tags | string\\[\\] | | Associated tags for the list. |\n| description | string | | Description of the list. |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X PUT 'http://localhost:9000/api/lists/5' \\\n--form 'name=modified test list' \\\n--form 'type=private'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 5,\n \"created_at\": \"2020-03-07T06:31:06.072483+01:00\",\n \"updated_at\": \"2020-03-07T06:52:15.208075+01:00\",\n \"uuid\": \"1bb246ab-7417-4cef-bddc-8fc8fc941d3a\",\n \"name\": \"modified test list\",\n \"type\": \"private\",\n \"optin\": \"single\",\n \"status\": \"active\",\n \"tags\": [],\n \"subscriber_count\": 0,\n \"description\": \"This is a test list\"\n }\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/lists/{list_id}\n\nDelete a specific list.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------ | :----- | :------- | :------------------------ |\n| list_id | Number | Yes | ID of the list to delete. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X DELETE 'http://localhost:9000/api/lists/1'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/lists\n\nDelete multiple lists by IDs or by a search query.\n\n> **Note:** Users can only delete lists they have `manage` permission for. Any lists in the query that the user doesn't have permission to manage is ignored.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---- | :--------- | :---------------------------- | :----------------------------------------------------------------- |\n| id | number\\[\\] | Yes (if `query` not provided) | One or more list IDs to delete. |\n| query | string | Yes (if `id` not provided) | Search query to filter lists for deletion (same as the GET query). |\n\n##### Example Request (by IDs)\n\n```shell\ncurl -u \"api_user:token\" -X DELETE 'http://localhost:9000/api/lists?id=10&id=11&id=12'\n```\n\n##### Example Request (by search query)\n\n```shell\ncurl -u \"api_user:token\" -X DELETE 'http://localhost:9000/api/lists?query=test%20list'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n" }, { "path": "docs/docs/content/apis/media.md", "content": "# API / Media\n\nMethod | Endpoint | Description\n-------|------------------------------------------------------|---------------------------------\nGET | [/api/media](#get-apimedia) | Get uploaded media file\nGET | [/api/media/{media_id}](#get-apimediamedia_id) | Get specific uploaded media file\nPOST | [/api/media](#post-apimedia) | Upload media file\nDELETE | [/api/media/{media_id}](#delete-apimediamedia_id) | Delete uploaded media file\n\n______________________________________________________________________\n\n#### GET /api/media\n\nGet an uploaded media file.\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/media' \\\n--header 'Content-Type: multipart/form-data; boundary=--------------------------093715978792575906250298'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": [\n {\n \"id\": 1,\n \"uuid\": \"ec7b45ce-1408-4e5c-924e-965326a20287\",\n \"filename\": \"Media file\",\n \"created_at\": \"2020-04-08T22:43:45.080058+01:00\",\n \"thumb_url\": \"/uploads/image_thumb.jpg\",\n \"uri\": \"/uploads/image.jpg\"\n }\n ]\n}\n```\n______________________________________________________________________\n\n#### GET /api/media/{media_id}\n\nRetrieve a specific media.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:--------------|:----------|:---------|:-----------------|\n| media_id | Number | Yes | Media ID. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' 'http://localhost:9000/api/media/7' \n```\n\n##### Example Response\n\n```json\n{\n \"data\": \n {\n \"id\": 7,\n \"uuid\": \"62e32e97-d6ca-4441-923f-b62607000dd1\",\n \"filename\": \"ResumeB.pdf\",\n \"content_type\": \"application/pdf\",\n \"created_at\": \"2024-08-06T11:28:53.888257+05:30\",\n \"thumb_url\": null,\n \"provider\": \"filesystem\",\n \"meta\": {},\n \"url\": \"http://localhost:9000/uploads/ResumeB.pdf\"\n }\n}\n```\n______________________________________________________________________\n\n#### POST /api/media\n\nUpload a media file.\n\n##### Parameters\n\n| Field | Type | Required | Description |\n|-------|-----------|----------|---------------------|\n| file | File | Yes | Media file to upload|\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X POST 'http://localhost:9000/api/media' \\\n--header 'Content-Type: multipart/form-data; boundary=--------------------------183679989870526937212428' \\\n--form 'file=@/path/to/image.jpg'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 1,\n \"uuid\": \"ec7b45ce-1408-4e5c-924e-965326a20287\",\n \"filename\": \"Media file\",\n \"created_at\": \"2020-04-08T22:43:45.080058+01:00\",\n \"thumb_uri\": \"/uploads/image_thumb.jpg\",\n \"uri\": \"/uploads/image.jpg\"\n }\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/media/{media_id}\n\nDelete an uploaded media file.\n\n##### Parameters\n\n| Field | Type | Required | Description |\n|----------|-----------|----------|-------------------------|\n| media_id | number | Yes | ID of media file to delete |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X DELETE 'http://localhost:9000/api/media/1'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n" }, { "path": "docs/docs/content/apis/sdks.md", "content": "# SDKs and client libraries\n\nA list of 3rd party client libraries and SDKs that have been written for listmonk APIs.\n\n!!! note\n\tThe list is community sourced. They have not been verified and are not officially supported.\n\n- [WordPress - WooCommerce plugin](https://github.com/post-duif/integration-listmonk-wordpress-plugin) integration for listmonk\n- [listmonk ](https://github.com/mikeckennedy/listmonk) — Python API client\n- [listmonk-api](https://github.com/Knuckles-Team/listmonk-api) — Python API client\n- [frappe_listmonk](https://github.com/anandology/frappe_listmonk) — Frappe framework integration for listmonk\n- [auto-newsletter-listmonk](https://github.com/chaddyc/auto-newsletter-listmonk) — Ghost CMS integration\n- [listmonk-newsletter](https://github.com/iloveitaly/listmonk-newsletter) - RSS to listmonk integration for email newsletters\n- [listmonk-crysctal](https://github.com/russ/listmonk-crystal) — Crystal lang API client\n- [terraform-provider-listmonk](https://github.com/Muravlev/terraform-provider-listmonk) — Manage listmonk templates in Terraform\n- [listmonk-php-client](https://github.com/arunnabraham/listmonk-php-client) — PHP API client\n- [php-listmonk](https://github.com/junisan/php-listmonk) — PHP API client\n- [go-listmonk](https://github.com/EzeXchange-API/go-listmonk) — Go API client\n- [listmonk-nodejs-api](https://github.com/mihairaulea/listmonk-nodejs-api) — NodeJS API client\n- [@maloma/listmonk](https://codeberg.org/maloma/listmonk-sdk) — NodeJS/Bun Typescript SDK\n- [listmonk-laravel](https://github.com/theafolayan/listmonk-laravel) — Laravel API Client\n- [nuxt-listmonk](https://github.com/roncallyt/nuxt-listmonk) — Listmonk module for Nuxt.js\n- [listmonk-japi](https://codeberg.org/hlassiege/listmonk-japi) - Listmonk client for Java/kotlin\n- [listmonk-mcp](https://github.com/rhnvrm/listmonk-mcp) — MCP (Model Context Protocol) server for Claude integration\n- [N8N Nodes](https://github.com/wiesinghilker/n8n-nodes-listmonk) — Adds Listmonk Nodes for N8N Automations\n" }, { "path": "docs/docs/content/apis/subscribers.md", "content": "# API / Subscribers\n\n| Method | Endpoint | Description |\n| ------ | --------------------------------------------------------------------------------------- | ---------------------------------------------- |\n| GET | [/api/subscribers](#get-apisubscribers) | Query and retrieve subscribers. |\n| GET | [/api/subscribers/{subscriber_id}](#get-apisubscriberssubscriber_id) | Retrieve a specific subscriber. |\n| GET | [/api/subscribers/{subscriber_id}/export](#get-apisubscriberssubscriber_idexport) | Export a specific subscriber. |\n| GET | [/api/subscribers/{subscriber_id}/bounces](#get-apisubscriberssubscriber_idbounces) | Retrieve a subscriber bounce records. |\n| POST | [/api/subscribers](#post-apisubscribers) | Create a new subscriber. |\n| POST | [/api/subscribers/{subscriber_id}/optin](#post-apisubscriberssubscriber_idoptin) | Sends optin confirmation email to subscribers. |\n| POST | [/api/public/subscription](#post-apipublicsubscription) | Create a public subscription. |\n| PUT | [/api/subscribers/lists](#put-apisubscriberslists) | Modify subscriber list memberships. |\n| PUT | [/api/subscribers/{subscriber_id}](#put-apisubscriberssubscriber_id) | Update a specific subscriber. |\n| PUT | [/api/subscribers/{subscriber_id}/blocklist](#put-apisubscriberssubscriber_idblocklist) | Blocklist a specific subscriber. |\n| PUT | [/api/subscribers/blocklist](#put-apisubscribersblocklist) | Blocklist one or many subscribers. |\n| PUT | [/api/subscribers/query/blocklist](#put-apisubscribersqueryblocklist) | Blocklist subscribers based on SQL expression. |\n| DELETE | [/api/subscribers/{subscriber_id}](#delete-apisubscriberssubscriber_id) | Delete a specific subscriber. |\n| DELETE | [/api/subscribers/{subscriber_id}/bounces](#delete-apisubscriberssubscriber_idbounces) | Delete a specific subscriber's bounce records. |\n| DELETE | [/api/subscribers](#delete-apisubscribers) | Delete one or more subscribers. |\n| POST | [/api/subscribers/query/delete](#post-apisubscribersquerydelete) | Delete subscribers based on SQL expression. |\n\n______________________________________________________________________\n\n#### GET /api/subscribers\n\nRetrieve all subscribers.\n\n##### Query parameters\n\n| Name | Type | Required | Description |\n| :------------------ | :----- | :------- | :-------------------------------------------------------------------- |\n| query | string | | Subscriber search by SQL expression. |\n| list_id | int[] | | ID of lists to filter by. Repeat in the query for multiple values. |\n| subscription_status | string | | Subscription status to filter by if there are one or more `list_id`s. |\n| order_by | string | | Result sorting field. Options: name, status, created_at, updated_at. |\n| order | string | | Sorting order: ASC for ascending, DESC for descending. |\n| page | number | | Page number for paginated results. |\n| per_page | number | | Results per page. Set as 'all' for all results. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' 'http://localhost:9000/api/subscribers?page=1&per_page=100' \n```\n\n```shell\ncurl -u 'api_username:access_token' 'http://localhost:9000/api/subscribers?list_id=1&list_id=2&page=1&per_page=100'\n```\n\n```shell\ncurl -u 'api_username:access_token' -X GET 'http://localhost:9000/api/subscribers' \\\n --url-query 'page=1' \\\n --url-query 'per_page=100' \\\n --url-query \"query=subscribers.name LIKE 'Test%' AND subscribers.attribs->>'city' = 'Bengaluru'\"\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"results\": [\n {\n \"id\": 1,\n \"created_at\": \"2020-02-10T23:07:16.199433+01:00\",\n \"updated_at\": \"2020-02-10T23:07:16.199433+01:00\",\n \"uuid\": \"ea06b2e7-4b08-4697-bcfc-2a5c6dde8f1c\",\n \"email\": \"john@example.com\",\n \"name\": \"John Doe\",\n \"attribs\": {\n \"city\": \"Bengaluru\",\n \"good\": true,\n \"type\": \"known\"\n },\n \"status\": \"enabled\",\n \"lists\": [\n {\n \"subscription_status\": \"unconfirmed\",\n \"id\": 1,\n \"uuid\": \"ce13e971-c2ed-4069-bd0c-240e9a9f56f9\",\n \"name\": \"Default list\",\n \"type\": \"public\",\n \"tags\": [\n \"test\"\n ],\n \"created_at\": \"2020-02-10T23:07:16.194843+01:00\",\n \"updated_at\": \"2020-02-10T23:07:16.194843+01:00\"\n }\n ]\n },\n {\n \"id\": 2,\n \"created_at\": \"2020-02-18T21:10:17.218979+01:00\",\n \"updated_at\": \"2020-02-18T21:10:17.218979+01:00\",\n \"uuid\": \"ccf66172-f87f-4509-b7af-e8716f739860\",\n \"email\": \"quadri@example.com\",\n \"name\": \"quadri\",\n \"attribs\": {},\n \"status\": \"enabled\",\n \"lists\": [\n {\n \"subscription_status\": \"unconfirmed\",\n \"id\": 1,\n \"uuid\": \"ce13e971-c2ed-4069-bd0c-240e9a9f56f9\",\n \"name\": \"Default list\",\n \"type\": \"public\",\n \"tags\": [\n \"test\"\n ],\n \"created_at\": \"2020-02-10T23:07:16.194843+01:00\",\n \"updated_at\": \"2020-02-10T23:07:16.194843+01:00\"\n }\n ]\n },\n {\n \"id\": 3,\n \"created_at\": \"2020-02-19T19:10:49.36636+01:00\",\n \"updated_at\": \"2020-02-19T19:10:49.36636+01:00\",\n \"uuid\": \"5d940585-3cc8-4add-b9c5-76efba3c6edd\",\n \"email\": \"sugar@example.com\",\n \"name\": \"sugar\",\n \"attribs\": {},\n \"status\": \"enabled\",\n \"lists\": []\n }\n ],\n \"query\": \"\",\n \"total\": 3,\n \"per_page\": 20,\n \"page\": 1\n }\n}\n```\n\n______________________________________________________________________\n\n#### GET /api/subscribers/{subscriber_id}\n\nRetrieve a specific subscriber.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------------ | :----- | :------- | :--------------- |\n| subscriber_id | Number | Yes | Subscriber's ID. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' 'http://localhost:9000/api/subscribers/1' \n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 1,\n \"created_at\": \"2020-02-10T23:07:16.199433+01:00\",\n \"updated_at\": \"2020-02-10T23:07:16.199433+01:00\",\n \"uuid\": \"ea06b2e7-4b08-4697-bcfc-2a5c6dde8f1c\",\n \"email\": \"john@example.com\",\n \"name\": \"John Doe\",\n \"attribs\": {\n \"city\": \"Bengaluru\",\n \"good\": true,\n \"type\": \"known\"\n },\n \"status\": \"enabled\",\n \"lists\": [\n {\n \"subscription_status\": \"unconfirmed\",\n \"id\": 1,\n \"uuid\": \"ce13e971-c2ed-4069-bd0c-240e9a9f56f9\",\n \"name\": \"Default list\",\n \"type\": \"public\",\n \"tags\": [\n \"test\"\n ],\n \"created_at\": \"2020-02-10T23:07:16.194843+01:00\",\n \"updated_at\": \"2020-02-10T23:07:16.194843+01:00\"\n }\n ]\n }\n}\n```\n______________________________________________________________________\n\n#### GET /api/subscribers/{subscriber_id}/export\n\nExport a specific subscriber data that gives profile, list subscriptions, campaign views and link clicks information. Names of private lists are replaced with \"Private list\". \n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------------ | :----- | :------- | :--------------- |\n| subscriber_id | Number | Yes | Subscriber's ID. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' 'http://localhost:9000/api/subscribers/1/export' \n```\n\n##### Example Response\n\n```json\n{\n \"profile\": [\n {\n \"id\": 1,\n \"uuid\": \"c2cc0b31-b485-4d72-8ce8-b47081beadec\",\n \"email\": \"john@example.com\",\n \"name\": \"John Doe\",\n \"attribs\": {\n \"city\": \"Bengaluru\",\n \"good\": true,\n \"type\": \"known\"\n },\n \"status\": \"enabled\",\n \"created_at\": \"2024-07-29T11:01:31.478677+05:30\",\n \"updated_at\": \"2024-07-29T11:01:31.478677+05:30\"\n }\n ],\n \"subscriptions\": [\n {\n \"subscription_status\": \"unconfirmed\",\n \"name\": \"Private list\",\n \"type\": \"private\",\n \"created_at\": \"2024-07-29T11:01:31.478677+05:30\"\n }\n ],\n \"campaign_views\": [],\n \"link_clicks\": []\n}\n```\n______________________________________________________________________\n\n#### GET /api/subscribers/{subscriber_id}/bounces\n\nGet a specific subscriber bounce records.\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------------ | :----- | :------- | :--------------- |\n| subscriber_id | Number | Yes | Subscriber's ID. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' 'http://localhost:9000/api/subscribers/1/bounces' \n```\n\n##### Example Response\n\n```json\n{\n \"data\": [\n {\n \"id\": 841706,\n \"type\": \"hard\",\n \"source\": \"demo\",\n \"meta\": {\n \"some\": \"parameter\"\n },\n \"created_at\": \"2024-08-22T09:05:12.862877Z\",\n \"email\": \"thomas.hobbes@example.com\",\n \"subscriber_uuid\": \"137c0d83-8de6-44e2-a55f-d4238ab21969\",\n \"subscriber_id\": 99,\n \"campaign\": {\n \"id\": 2,\n \"name\": \"Welcome to listmonk\"\n }\n },\n {\n \"id\": 841680,\n \"type\": \"hard\",\n \"source\": \"demo\",\n \"meta\": {\n \"some\": \"parameter\"\n },\n \"created_at\": \"2024-08-19T14:07:53.141917Z\",\n \"email\": \"thomas.hobbes@example.com\",\n \"subscriber_uuid\": \"137c0d83-8de6-44e2-a55f-d4238ab21969\",\n \"subscriber_id\": 99,\n \"campaign\": {\n \"id\": 1,\n \"name\": \"Test campaign\"\n }\n }\n ]\n}\n```\n\n______________________________________________________________________\n\n#### POST /api/subscribers\n\nCreate a new subscriber.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:-------------------------|:-----------|:---------|:------------------------------------------------------------------------------------------------------------------------------|\n| email | string | Yes | Subscriber's email address. |\n| name | string | Yes | Subscriber's name. |\n| status | string | Yes | Subscriber's status: `enabled`, `blocklisted`. |\n| lists | number\\[\\] | | List of list IDs to subscribe to. |\n| attribs | JSON | | Optional JSON object attributes for the subscriber that can be used in message templates. Example `{\"location\": \"Somewhere\"}` |\n| preconfirm_subscriptions | bool | | If true, subscriptions are marked as confirmed and no opt-in emails are sent for double opt-in lists. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' 'http://localhost:9000/api/subscribers' -H 'Content-Type: application/json' \\\n --data '{\"email\":\"subscriber@domain.com\",\"name\":\"The Subscriber\",\"status\":\"enabled\",\"lists\":[1],\"attribs\":{\"city\":\"Bengaluru\",\"projects\":3,\"stack\":{\"languages\":[\"go\",\"python\"]}}}'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 3,\n \"created_at\": \"2019-07-03T12:17:29.735507+05:30\",\n \"updated_at\": \"2019-07-03T12:17:29.735507+05:30\",\n \"uuid\": \"eb420c55-4cfb-4972-92ba-c93c34ba475d\",\n \"email\": \"subscriber@domain.com\",\n \"name\": \"The Subscriber\",\n \"attribs\": {\n \"city\": \"Bengaluru\",\n \"projects\": 3,\n \"stack\": { \"languages\": [\"go\", \"python\"] }\n },\n \"status\": \"enabled\",\n \"lists\": [1]\n }\n}\n```\n\n______________________________________________________________________\n\n#### POST /api/subscribers/{subscribers_id}/optin\n\nSends opt-in confirmation email to subscribers.\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' 'http://localhost:9000/api/subscribers/11/optin' -H 'Content-Type: application/json' \\\n--data {}\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n} \n```\n______________________________________________________________________\n\n#### POST /api/public/subscription\n\nCreate a public subscription, accepts both form encoded or JSON encoded body.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :--------- | :--------- | :------- | :-------------------------- |\n| email | string | Yes | Subscriber's email address. |\n| name | string | | Subscriber's name. |\n| list_uuids | string\\[\\] | Yes | List of list UUIDs. |\n\n##### Example JSON Request\n\n```shell\ncurl 'http://localhost:9000/api/public/subscription' -H 'Content-Type: application/json' \\\n --data '{\"email\":\"subscriber@domain.com\",\"name\":\"The Subscriber\",\"list_uuids\": [\"eb420c55-4cfb-4972-92ba-c93c34ba475d\", \"0c554cfb-eb42-4972-92ba-c93c34ba475d\"]}'\n```\n\n##### Example Form Request\n\n```shell\ncurl -u 'http://localhost:9000/api/public/subscription' \\\n -d 'email=subscriber@domain.com' -d 'name=The Subscriber' -d 'l=eb420c55-4cfb-4972-92ba-c93c34ba475d' -d 'l=0c554cfb-eb42-4972-92ba-c93c34ba475d'\n```\n\nNote: For form request, use `l` for multiple lists instead of `lists`.\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### PUT /api/subscribers/lists\n\nModify subscriber list memberships.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :-------------- | :--------- | :----------------- | :---------------------------------------------------------------- |\n| ids | number\\[\\] | Yes | Array of user IDs to be modified. |\n| action | string | Yes | Action to be applied: `add`, `remove`, or `unsubscribe`. |\n| target_list_ids | number\\[\\] | Yes | Array of list IDs to be modified. |\n| status | string | Required for `add` | Subscriber status: `confirmed`, `unconfirmed`, or `unsubscribed`. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X PUT 'http://localhost:9000/api/subscribers/lists' \\\n-H 'Content-Type: application/json' \\\n--data-raw '{\"ids\": [1, 2, 3], \"action\": \"add\", \"target_list_ids\": [4, 5, 6], \"status\": \"confirmed\"}'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n} \n```\n\n______________________________________________________________________\n\n#### PUT /api/subscribers/{subscriber_id}\n\nUpdate a specific subscriber.\n\n> Refer to parameters from [POST /api/subscribers](#post-apisubscribers). Note: All parameters must be set, if not, the subscriber will be removed from all previously assigned lists.\n\n______________________________________________________________________\n\n#### PUT /api/subscribers/{subscriber_id}/blocklist\n\nBlocklist a specific subscriber.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------------ | :----- | :------- | :--------------- |\n| subscriber_id | Number | Yes | Subscriber's ID. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X PUT 'http://localhost:9000/api/subscribers/9/blocklist'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n} \n```\n\n______________________________________________________________________\n\n#### PUT /api/subscribers/blocklist\n\nBlocklist multiple subscriber.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :--- | :----- | :------- | :--------------- |\n| ids | Number | Yes | Subscriber's ID. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X PUT 'http://localhost:8080/api/subscribers/blocklist' -H 'Content-Type: application/json' --data-raw '{\"ids\":[2,1]}'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n} \n```\n\n______________________________________________________________________\n\n#### PUT /api/subscribers/query/blocklist\n\nBlocklist subscribers based on SQL expression.\n\n> Refer to the [querying and segmentation](../querying-and-segmentation.md#querying-and-segmenting-subscribers) section for more information on how to query subscribers with SQL expressions.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------- | :------- | :------- | :------------------------------------------- |\n| query | string | Yes | SQL expression to filter subscribers with. |\n| list_ids | []number | No | Optional list IDs to limit the filtering to. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X POST 'http://localhost:9000/api/subscribers/query/blocklist' \\\n-H 'Content-Type: application/json' \\\n--data-raw '{\"query\":\"subscribers.name LIKE \\'John Doe\\' AND subscribers.attribs->>'\\''city'\\'' = '\\''Bengaluru'\\''\"}'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/subscribers/{subscriber_id}\n\nDelete a specific subscriber.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------------ | :----- | :------- | :--------------- |\n| subscriber_id | Number | Yes | Subscriber's ID. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X DELETE 'http://localhost:9000/api/subscribers/9'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/subscribers/{subscriber_id}/bounces\n\nDelete a subscriber's bounce records\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :--- | :------------ | :------- | :--------------- |\n| id | subscriber_id | Yes | Subscriber's ID. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X DELETE 'http://localhost:9000/api/subscribers/9/bounces'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/subscribers\n\nDelete one or more subscribers.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :--- | :--------- | :------- | :------------------------- |\n| id | number\\[\\] | Yes | Array of subscriber's IDs. |\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X DELETE 'http://localhost:9000/api/subscribers?id=10&id=11'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n\n______________________________________________________________________\n\n#### POST /api/subscribers/query/delete\n\nDelete subscribers based on SQL expression.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :------- | :------- | :------- | :----------------------------------------------------------------- |\n| query | string | No | SQL expression to filter subscribers with. |\n| list_ids | []number | No | Optional list IDs to limit the filtering to. |\n| all | bool | No | When set to `true`, ignores any query and deletes all subscribers. |\n\n\n##### Example Request\n\n```shell\ncurl -u 'api_username:access_token' -X POST 'http://localhost:9000/api/subscribers/query/delete' \\\n-H 'Content-Type: application/json' \\\n--data-raw '{\"query\":\"subscribers.name LIKE \\'John Doe\\' AND subscribers.attribs->>'\\''city'\\'' = '\\''Bengaluru'\\''\"}'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n" }, { "path": "docs/docs/content/apis/templates.md", "content": "# API / Templates\n\n| Method | Endpoint | Description |\n|:-------|:------------------------------------------------------------------------------|:-------------------------------|\n| GET | [/api/templates](#get-apitemplates) | Retrieve all templates |\n| GET | [/api/templates/{template_id}](#get-apitemplates-template_id) | Retrieve a template |\n| GET | [/api/templates/{template_id}/preview](#get-apitemplates-template_id-preview) | Retrieve template HTML preview |\n| POST | [/api/templates](#post-apitemplates) | Create a template |\n| POST | /api/templates/preview | Render and preview a template |\n| PUT | [/api/templates/{template_id}](#put-apitemplatestemplate_id) | Update a template |\n| PUT | [/api/templates/{template_id}/default](#put-apitemplates-template_id-default) | Set default template |\n| DELETE | [/api/templates/{template_id}](#delete-apitemplates-template_id) | Delete a template |\n\n______________________________________________________________________\n\n#### GET /api/templates\n\nRetrieve all templates.\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/templates'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": [\n {\n \"id\": 1,\n \"created_at\": \"2020-03-14T17:36:41.288578+01:00\",\n \"updated_at\": \"2020-03-14T17:36:41.288578+01:00\",\n \"name\": \"Default template\",\n \"body\": \"{{ template \\\"content\\\" . }}\",\n \"body_source\": null,\n \"type\": \"campaign\",\n \"is_default\": true\n }\n ]\n}\n```\n\n______________________________________________________________________\n\n#### GET /api/templates/{template_id}\n\nRetrieve a specific template.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:------------|:----------|:---------|:-------------------------------|\n| template_id | number | Yes | ID of the template to retrieve |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/templates/1'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 1,\n \"created_at\": \"2020-03-14T17:36:41.288578+01:00\",\n \"updated_at\": \"2020-03-14T17:36:41.288578+01:00\",\n \"name\": \"Default template\",\n \"body\": \"{{ template \\\"content\\\" . }}\",\n \"body_source\": null,\n \"type\": \"campaign\",\n \"is_default\": true\n }\n}\n```\n\n______________________________________________________________________\n\n#### GET /api/templates/{template_id}/preview\n\nRetrieve the HTML preview of a template.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:------------|:----------|:---------|:------------------------------|\n| template_id | number | Yes | ID of the template to preview |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X GET 'http://localhost:9000/api/templates/1/preview'\n```\n\n##### Example Response\n\n```html\nHi there
\nLorem ipsum dolor sit amet, consectetur adipiscing elit. Duis et elit ac elit sollicitudin condimentum non a magna.\n\tSed tempor mauris in facilisis vehicula. Aenean nisl urna, accumsan ac tincidunt vitae, interdum cursus massa.\n\tInterdum et malesuada fames ac ante ipsum primis in faucibus. Aliquam varius turpis et turpis lacinia placerat.\n\tAenean id ligula a orci lacinia blandit at eu felis. Phasellus vel lobortis lacus. Suspendisse leo elit, luctus sed\n\terat ut, venenatis fermentum ipsum. Donec bibendum neque quis.
\n\nSub heading
\nNam luctus dui non placerat mattis. Morbi non accumsan orci, vel interdum urna. Duis faucibus id nunc ut euismod.\n\tCurabitur et eros id erat feugiat fringilla in eget neque. Aliquam accumsan cursus eros sed faucibus.
\n\nHere is a link to listmonk.
\n```\n\n______________________________________________________________________\n\n#### POST /api/templates\n\nCreate a template.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:------------|:-------|:---------|:------------------------------------------------------------------------------|\n| name | string | Yes | Name of the template |\n| type | string | Yes | Type of the template (`campaign`, `campaign_visual`, or `tx`) |\n| subject | string | | Subject line for the template (only for `tx`) |\n| body_source | string | | If type is `campaign_visual`, the JSON source for the email-builder tempalate |\n| body | string | Yes | HTML body of the template |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X POST 'http://localhost:9000/api/templates' \\\n-H 'Content-Type: application/json' \\\n-d '{\n \"name\": \"New template\",\n \"type\": \"campaign\",\n \"subject\": \"Your Weekly Newsletter\",\n \"body\": \"Header
Content goes here
\"\n}'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": [\n {\n \"id\": 1,\n \"created_at\": \"2020-03-14T17:36:41.288578+01:00\",\n \"updated_at\": \"2020-03-14T17:36:41.288578+01:00\",\n \"name\": \"Default template\",\n \"body\": \"{{ template \\\"content\\\" . }}\",\n \"body_source\": null,\n \"type\": \"campaign\",\n \"is_default\": true\n }\n ]\n}\n```\n\n______________________________________________________________________\n\n#### PUT /api/templates/{template_id}\n\nUpdate a template.\n\n> Refer to parameters from [POST /api/templates](#post-apitemplates)\n\n______________________________________________________________________\n\n#### PUT /api/templates/{template_id}/default\n\nSet a template as the default.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:------------|:----------|:---------|:-------------------------------------|\n| template_id | number | Yes | ID of the template to set as default |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X PUT 'http://localhost:9000/api/templates/1/default'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": {\n \"id\": 1,\n \"created_at\": \"2020-03-14T17:36:41.288578+01:00\",\n \"updated_at\": \"2020-03-14T17:36:41.288578+01:00\",\n \"name\": \"Default template\",\n \"body\": \"{{ template \\\"content\\\" . }}\",\n \"body_source\": null,\n \"type\": \"campaign\",\n \"is_default\": true\n }\n}\n```\n\n______________________________________________________________________\n\n#### DELETE /api/templates/{template_id}\n\nDelete a template.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n|:------------|:----------|:---------|:-----------------------------|\n| template_id | number | Yes | ID of the template to delete |\n\n##### Example Request\n\n```shell\ncurl -u \"api_user:token\" -X DELETE 'http://localhost:9000/api/templates/35'\n```\n\n##### Example Response\n\n```json\n{\n \"data\": true\n}\n```\n" }, { "path": "docs/docs/content/apis/transactional.md", "content": "# API / Transactional\n\n| Method | Endpoint | Description |\n| :----- | :------- | :-------------------------- |\n| POST | /api/tx | Send transactional messages |\n\n______________________________________________________________________\n\n#### POST /api/tx\n\nAllows sending transactional messages to one or more subscribers via a preconfigured transactional template.\n\n##### Parameters\n\n| Name | Type | Required | Description |\n| :---------------- | :--------- | :------- | :------------------------------------------------------------------------- |\n| subscriber_email | string | | Email of the subscriber. Can substitute with `subscriber_id`. |\n| subscriber_id | number | | Subscriber's ID can substitute with `subscriber_email`. |\n| subscriber_emails | string\\[\\] | | Multiple subscriber emails as alternative to `subscriber_email`. |\n| subscriber_ids | number\\[\\] | | Multiple subscriber IDs as an alternative to `subscriber_id`. |\n| subscriber_mode | string | | Subscriber lookup mode: `default`, `fallback`, or `external` |\n| template_id | number | Yes | ID of the transactional template to be used for the message. |\n| from_email | string | | Optional sender email. |\n| subject | string | | Optional subject. If empty, the subject defined on the template is used |\n| data | JSON | | Optional nested JSON map. Available in the template as `{{ .Tx.Data.* }}`. |\n| headers | JSON\\[\\] | | Optional array of email headers. |\n| messenger | string | | Messenger to send the message. Default is `email`. |\n| content_type | string | | Email format options include `html`, `markdown`, and `plain`. |\n| altbody | string | | Optional alternate plaintext body for multipart HTML emails. |\n\n##### Subscriber modes\n\nThe `subscriber_mode` parameter controls how the recipients (subscribers or non-subscriber recipients) are resolved.\n\n| Mode | Description |\n| :--------- | :----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |\n| `default` | Recipients must exist as subscribers in the database. Pass either `subscriber_emails` or `subscriber_ids`. |\n| `fallback` | Only accepts `subscriber_emails` and looks up subscribers in the database. If not found, sends the message to the e-mail anyway. In the template, apart from `{{ .Subscriber.Email }}`, other subscriber fields such as `.Name`. will be empty. Use `{{ Tx.Data.* }}` instead. |\n| `external` | Sends to the given `subscriber_emails` without subscriber lookup in the database. In the template, apart from `{{ .Subscriber.Email }}`, other subscriber fields such as `.Name`. will be empty. Use `{{ Tx.Data.* }}` instead. |\n\n##### Example\n\n```shell\ncurl -u \"api_user:token\" \"http://localhost:9000/api/tx\" -X POST \\\n -H 'Content-Type: application/json; charset=utf-8' \\\n --data-binary @- << EOF\n {\n \"subscriber_email\": \"user@test.com\",\n \"template_id\": 2,\n \"data\": {\"order_id\": \"1234\", \"date\": \"2022-07-30\", \"items\": [1, 2, 3]},\n \"content_type\": \"html\"\n }\nEOF\n```\n\n##### Example response\n\n```json\n{\n \"data\": true\n}\n```\n\n##### Example with external mode\n\nSend to arbitrary email addresses without requiring them to be subscribers:\n\n```shell\ncurl -u \"api_user:token\" \"http://localhost:9000/api/tx\" -X POST \\\n -H 'Content-Type: application/json; charset=utf-8' \\\n --data-binary @- << EOF\n {\n \"subscriber_mode\": \"external\",\n \"subscriber_emails\": [\"recipient@example.com\"],\n \"template_id\": 2,\n \"data\": {\"name\": \"John\", \"order_id\": \"1234\"},\n \"content_type\": \"html\"\n }\nEOF\n```\n\nIn the template, use `{{ .Tx.Data.name }}`, `{{ .Tx.Data.order_id }}`, etc. to access the data.\n\n______________________________________________________________________\n\n#### File Attachments\n\nTo include file attachments in a transactional message, use the `multipart/form-data` Content-Type. Use `data` param for the parameters described above as a JSON object. Include any number of attachments via the `file` param.\n\n```shell\ncurl -u \"api_user:token\" \"http://localhost:9000/api/tx\" -X POST \\\n-F 'data=\\\"{\n \\\"subscriber_email\\\": \\\"user@test.com\\\",\n \\\"template_id\\\": 4\n}\"' \\\n-F 'file=@\"/path/to/attachment.pdf\"' \\\n-F 'file=@\"/path/to/attachment2.pdf\"'\n```\n" }, { "path": "docs/docs/content/archives.md", "content": "# Archives\n\nA global public archive is maintained on the public web interface. It can be\nenabled under Settings -> Settings -> General -> Enable public mailing list\narchive.\n\nTo make a campaign available in the public archive (provided it has been\nenabled in the settings as described above), enable the option\n'Publish to public archive' under Campaigns -> Create new -> Archive.\n\nWhen using template variables that depend on subscriber data (such as any\ntemplate variable referencing `.Subscriber`), such data must be supplied\nas 'Campaign metadata', which is a JSON object that will be used in place\nof `.Subscriber` when rendering the archive template and content.\n\nWhen individual subscriber tracking is enabled, TrackLink requires that a UUID\nof an existing user is provided as part of the campaign metadata. Any clicks on\na TrackLink from the archived campaign will be counted towards that subscriber.\n\nAs an example:\n\n```json\n{\n \"UUID\": \"5a837423-a186-5623-9a87-82691cbe3631\",\n \"email\": \"example@example.com\",\n \"name\": \"Reader\",\n \"attribs\": {}\n}\n```\n\n\n\n" }, { "path": "docs/docs/content/bounces.md", "content": "# Bounce processing\n\nEnable bounce processing in Settings -> Bounces. POP3 bounce scanning and APIs only become available once the setting is enabled.\n\n## POP3 bounce mailbox\nConfigure the bounce mailbox in Settings -> Bounces. Either the \"From\" e-mail that is set on a campaign (or in settings) should have a POP3 mailbox behind it to receive bounce e-mails, or you should configure a dedicated POP3 mailbox and add that address as the `Return-Path` (envelope sender) header in Settings -> SMTP -> Custom headers box. For example:\n\n```\n[\n\t{\"Return-Path\": \"your-bounce-inbox@site.com\"}\n]\n\n```\n\nSome mail servers may also return the bounce to the `Reply-To` address, which can also be added to the header settings.\n\n### Bounce classification\nlistmonk applies a series of heuristics looking for keywords in the bounced mail body to guess if it is a 'soft' bounce or a 'hard' bounce. For instance, 4.x.x and 5.x.x error status codes, common strings such as \"mailbox not found\" etc. If none of the heuristics match, then the bounce mail is considered to be 'soft' by default.\n\n## Webhook API\nThe bounce webhook API can be used to record bounce events with custom scripting. This could be by reading a mailbox, a database, or mail server logs.\n\n| Method | Endpoint | Description |\n| ------ | ---------------- | ---------------------- |\n| `POST` | /webhooks/bounce | Record a bounce event. |\n\n\n| Name | Type | Required | Description |\n| --------------- | ------ | -------- | ------------------------------------------------------------------------------------ |\n| subscriber_uuid | string | | The UUID of the subscriber. Either this or `email` is required. |\n| email | string | | The e-mail of the subscriber. Either this or `subscriber_uuid` is required. |\n| campaign_uuid | string | | UUID of the campaign for which the bounce happened. |\n| source | string | Yes | A string indicating the source, eg: `api`, `my_script` etc. |\n| type | string | Yes | `hard` or `soft` bounce. Currently, this has no effect on how the bounce is treated. |\n| meta | string | | An optional escaped JSON string with arbitrary metadata about the bounce event. |\n \n\n```shell\ncurl -u 'api_username:access_token' -X POST 'http://localhost:9000/webhooks/bounce' \\\n\t-H \"Content-Type: application/json\" \\\n\t--data '{\"email\": \"user1@mail.com\", \"campaign_uuid\": \"9f86b50d-5711-41c8-ab03-bc91c43d711b\", \"source\": \"api\", \"type\": \"hard\", \"meta\": \"{\\\"additional\\\": \\\"info\\\"}}'\n\n```\n\n## External webhooks\nlistmonk supports receiving bounce webhook events from the following SMTP providers.\n\n| Endpoint | Description | More info |\n| :------------------------------------------------------------ | :------------------------------------- | :-------------------------------------------------------------------------------------------------------------------- |\n| `https://listmonk.yoursite.com/webhooks/service/ses` | Amazon (AWS) SES | See below |\n| `https://listmonk.yoursite.com/webhooks/service/sendgrid` | Sendgrid / Twilio Signed event webhook | [More info](https://docs.sendgrid.com/for-developers/tracking-events/getting-started-event-webhook-security-features) |\n| `https://listmonk.yoursite.com/webhooks/service/postmark` | Postmark webhook | [More info](https://postmarkapp.com/developer/webhooks/webhooks-overview) |\n| `https://listmonk.yoursite.com/webhooks/service/forwardemail` | Forward Email webhook | [More info](https://forwardemail.net/en/faq#do-you-support-bounce-webhooks) |\n\n## Amazon Simple Email Service (SES)\n\nIf using SES as your SMTP provider, automatic bounce processing is the recommended way to maintain your [sender reputation](https://docs.aws.amazon.com/ses/latest/dg/monitor-sender-reputation.html). The settings below are based on Amazon's [recommendations](https://docs.aws.amazon.com/ses/latest/dg/send-email-concepts-deliverability.html). Please note that your sending domain must be verified in SES before proceeding.\n\n1. In listmonk settings, go to the \"Bounces\" tab and configure the following:\n - Enable bounce processing: `Enabled`\n - Soft:\n - Bounce count: `2`\n - Action: `None`\n - Hard:\n - Bounce count: `1`\n - Action: `Blocklist`\n - Complaint: \n - Bounce count: `1`\n - Action: `Blocklist`\n - Enable bounce webhooks: `Enabled`\n - Enable SES: `Enabled`\n2. In the AWS console, go to [Simple Notification Service](https://console.aws.amazon.com/sns/) and create a new topic with the following settings:\n - Type: `Standard`\n - Name: `ses-bounces` (or any other name)\n3. Create a new subscription to that topic with the following settings:\n - Protocol: `HTTPS`\n - Endpoint: `https://listmonk.yoursite.com/webhooks/service/ses`\n - Enable raw message delivery: `Disabled` (unchecked)\n4. SES will then make a request to your listmonk instance to confirm the subscription. After a page refresh, the subscription should have a status of \"Confirmed\". If not, your endpoint may be incorrect or not publicly accessible.\n5. In the AWS console, go to [Simple Email Service](https://console.aws.amazon.com/ses/) and click \"Identities\" in the left sidebar.\n6. Click your domain and go to the \"Notifications\" tab.\n7. Next to \"Feedback notifications\", click \"Edit\".\n8. For both \"Bounce feedback\" and \"Complaint feedback\", use the following settings:\n - SNS topic: `ses-bounces` (or whatever you named it)\n - Include original email headers: `Enabled` (checked)\n9. Repeat steps 6-8 for any `Email address` identities you send from using listmonk\n10. Bounce processing should now be working. You can test it with [SES simulator addresses](https://docs.aws.amazon.com/ses/latest/dg/send-an-email-from-console.html#send-email-simulator). Add them as subscribers, send them campaign previews, and ensure that the appropriate action was taken after the configured bounce count was reached.\n - Soft bounce: `ooto@simulator.amazonses.com`\n - Hard bounce: `bounce@simulator.amazonses.com`\n - Complaint: `complaint@simulator.amazonses.com`\n11. You can optionally [disable email feedback forwarding](https://docs.aws.amazon.com/ses/latest/dg/monitor-sending-activity-using-notifications-email.html#monitor-sending-activity-using-notifications-email-disabling).\n\n## Exporting bounces\n\nBounces can be exported via the JSON API:\n```shell\ncurl -u 'username:passsword' 'http://localhost:9000/api/bounces'\n```\n\nOr by querying the database directly:\n```sql\nSELECT bounces.created_at,\n bounces.subscriber_id,\n subscribers.uuid AS subscriber_uuid,\n subscribers.email AS email\nFROM bounces\nLEFT JOIN subscribers ON (subscribers.id = bounces.subscriber_id)\nORDER BY bounces.created_at DESC LIMIT 1000;\n```\n" }, { "path": "docs/docs/content/concepts.md", "content": "# Concepts\n\n## Subscriber\n\nA subscriber is a recipient identified by an e-mail address and name. Subscribers receive e-mails that are sent from listmonk. A subscriber can be added to any number of lists. Subscribers who are not a part of any lists are considered *orphan* records.\n\n### Attributes\n\nAttributes are arbitrary properties attached to a subscriber in addition to their e-mail and name. They are represented as a JSON map. It is not necessary for all subscribers to have the same attributes. Subscribers can be [queried and segmented](querying-and-segmentation.md) into lists based on their attributes, and the attributes can be inserted into the e-mails sent to them. For example:\n\n```json\n{\n \"city\": \"Bengaluru\",\n \"likes_tea\": true,\n \"spoken_languages\": [\"English\", \"Malayalam\"],\n \"projects\": 3,\n \"stack\": {\n \"frameworks\": [\"echo\", \"go\"],\n \"languages\": [\"go\", \"python\"],\n \"preferred_language\": \"go\"\n }\n}\n```\n\n### Subscription statuses\n\nA subscriber can be added to one or more lists, and each such relationship can have one of these statuses.\n\n| Status | Description |\n|----------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| `unconfirmed` | The subscriber was added to the list directly without their explicit confirmation. Nonetheless, the subscriber will receive campaign messages sent to single opt-in campaigns. |\n| `confirmed` | The subscriber confirmed their subscription by clicking on 'accept' in the confirmation e-mail. Only confirmed subscribers in opt-in lists will receive campaign messages send to the list. |\n| `unsubscribed` | The subscriber is unsubscribed from the list and will not receive any campaign messages sent to the list. |\n\n### Segmentation\n\nSegmentation is the process of filtering a large list of subscribers into a smaller group based on arbitrary conditions, primarily based on their attributes. For instance, if an e-mail needs to be sent subscribers who live in a particular city, given their city is described in their attributes, it's possible to quickly filter them out into a new list and e-mail them. [Learn more](querying-and-segmentation.md).\n\n## List\n\nA list (or a _mailing list_) is a collection of subscribers grouped under a name, for instance, _clients_. Lists are used to organise subscribers and send e-mails to specific groups. A list can be single opt-in or double opt-in. Subscribers added to double opt-in lists have to explicitly accept the subscription by clicking on the confirmation e-mail they receive. Until then, they do not receive campaign messages.\n\n## Campaign\n\nA campaign is an e-mail (or any other kind of messages) that is sent to one or more lists.\n\n\n## Transactional message\n\nA transactional message is an arbitrary message sent to a subscriber using the transactional message API. For example a welcome e-mail on signing up to a service; an order confirmation e-mail on purchasing an item; a password reset e-mail when a user initiates an online account recovery process.\n\n\n## Template\n\nA template is a re-usable HTML design that can be used across campaigns and when sending arbitrary transactional messages. Most commonly, templates have standard header and footer areas with logos and branding elements, where campaign content is inserted in the middle. listmonk supports [Go template](https://gowebexamples.com/templates/) expressions that lets you create powerful, dynamic HTML templates. [Learn more](templating.md).\n\n## Messenger\n\nlistmonk supports multiple custom messaging backends in additional to the default SMTP e-mail backend, enabling not just e-mail campaigns, but arbitrary message campaigns such as SMS, FCM notifications etc. A *Messenger* is a web service that accepts a campaign message pushed to it as a JSON request, which the service can in turn broadcast as SMS, FCM etc. [Learn more](messengers.md).\n\n## Tracking pixel\n\nThe tracking pixel is a tiny, invisible image that is inserted into an e-mail body to track e-mail views. This allows measuring the read rate of e-mails. While this is exceedingly common in e-mail campaigns, it carries privacy implications and should be used in compliance with rules and regulations such as GDPR. It is possible to track reads anonymously without associating an e-mail read to a subscriber.\n\n## Click tracking\n\nIt is possible to track the clicks on every link that is sent in an e-mail. This allows measuring the clickthrough rates of links in e-mails. While this is exceedingly common in e-mail campaigns, it carries privacy implications and should be used in compliance with rules and regulations such as GDPR. It is possible to track link clicks anonymously without associating an e-mail read to a subscriber.\n\n## Bounce\n\nA bounce occurs when an e-mail that is sent to a recipient \"bounces\" back for one of many reasons including the recipient address being invalid, their mailbox being full, or the recipient's e-mail service provider marking the e-mail as spam. listmonk can automatically process such bounce e-mails that land in a configured POP mailbox, or via APIs of SMTP e-mail providers such as AWS SES and Sengrid. Based on settings, subscribers returning bounced e-mails can either be blocklisted or deleted automatically. [Learn more](bounces.md).\n" }, { "path": "docs/docs/content/configuration.md", "content": "# Configuration\n\n### TOML Configuration file\nOne or more TOML files can be read by passing `--config config.toml` multiple times. Apart from a few low level configuration variables and the database configuration, all other settings can be managed from the `Settings` dashboard on the admin UI.\n\nTo generate a new sample configuration file, run `listmonk --new-config`\n\n### Environment variables\nVariables in config.toml can also be provided as environment variables prefixed by `LISTMONK_` with periods replaced by `__` (double underscore). To start listmonk purely with environment variables without a configuration file, set the environment variables and pass the config flag as `--config=\"\"`.\n\nExample:\n\n| **Environment variable** | Example value |\n| ------------------------------ | -------------- |\n| `LISTMONK_app__address` | \"0.0.0.0:9000\" |\n| `LISTMONK_db__host` | db |\n| `LISTMONK_db__port` | 9432 |\n| `LISTMONK_db__user` | listmonk |\n| `LISTMONK_db__password` | listmonk |\n| `LISTMONK_db__database` | listmonk |\n| `LISTMONK_db__ssl_mode` | disable |\n\n\n### Customizing system templates\nSee [system templates](templating.md#system-templates).\n\n\n### HTTP routes\nWhen configuring auth proxies and web application firewalls, use this table.\n\n#### Private admin endpoints.\n\n| Methods | Route | Description |\n| ------- | ------------------ | ----------------------- |\n| `*` | `/api/*` | Admin APIs |\n| `GET` | `/admin/*` | Admin UI and HTML pages |\n| `POST` | `/webhooks/bounce` | Admin bounce webhook |\n\n\n#### Public endpoints to expose to the internet.\n\n| Methods | Route | Description |\n| ----------- | --------------------- | --------------------------------------------- |\n| `GET, POST` | `/subscription/*` | HTML subscription pages |\n| `GET, ` | `/link/*` | Tracked link redirection |\n| `GET` | `/campaign/*` | Pixel tracking image |\n| `GET` | `/public/*` | Static files for HTML subscription pages |\n| `POST` | `/webhooks/service/*` | Bounce webhook endpoints for AWS and Sendgrid |\n| `GET` | `/uploads/*` | The file upload path configured in media settings |\n\n\n## Media uploads\n\n#### Using filesystem\n\nWhen configuring `docker` volume mounts for using filesystem media uploads, you can follow either of two approaches. [The second option may be necessary if](https://github.com/knadh/listmonk/issues/1169#issuecomment-1674475945) your setup requires you to use `sudo` for docker commands. \n\nAfter making any changes you will need to run `sudo docker compose stop ; sudo docker compose up`. \n\nAnd under `https://listmonk.mysite.com/admin/settings` you put `/listmonk/uploads`. \n\n#### Using volumes\n\nUsing `docker volumes`, you can specify the name of volume and destination for the files to be uploaded inside the container.\n\n\n```yml\napp:\n volumes:\n - type: volume\n source: listmonk-uploads\n target: /listmonk/uploads\n\nvolumes:\n listmonk-uploads:\n```\n\n!!! note\n\n This volume is managed by `docker` itself, and you can see find the host path with `docker volume inspect listmonk_listmonk-uploads`.\n\n#### Using bind mounts\n\n```yml\n app:\n volumes:\n - ./path/on/your/host/:/path/inside/container\n```\nEg:\n```yml\n app:\n volumes:\n - ./data/uploads:/listmonk/uploads\n```\nThe files will be available inside `/data/uploads` directory on the host machine.\n\nTo use the default `uploads` folder:\n```yml\n app:\n volumes:\n - ./uploads:/listmonk/uploads\n```\n\n## Logs\n\n### Docker\n\nhttps://docs.docker.com/engine/reference/commandline/logs/\n```\nsudo docker logs -f\nsudo docker logs listmonk_app -t\nsudo docker logs listmonk_db -t\nsudo docker logs --help\n```\nContainer info: `sudo docker inspect listmonk_listmonk`\n\nDocker logs to `/dev/stdout` and `/dev/stderr`. The logs are collected by the docker daemon and stored in your node's host path (by default). The same can be configured (/etc/docker/daemon.json) in your docker daemon settings to setup other logging drivers, logrotate policy and more, which you can read about [here](https://docs.docker.com/config/containers/logging/configure/).\n\n### Binary\n\nlistmonk logs to `stdout`, which is usually not saved to any file. To save listmonk logs to a file use `./listmonk > listmonk.log`.\n\nSettings -> Logs in admin shows the last 1000 lines of the standard log output but gets erased when listmonk is restarted.\n\nFor the [service file](https://github.com/knadh/listmonk/blob/master/listmonk%40.service), you can use `ExecStart=/bin/bash -ce \"exec /usr/bin/listmonk --config /etc/listmonk/config.toml --static-dir /etc/listmonk/static >>/etc/listmonk/listmonk.log 2>&1\"` to create a log file that persists after restarts. [More info](https://github.com/knadh/listmonk/issues/1462#issuecomment-1868501606).\n\n\n## Time zone\n\nTo change listmonk's time zone (logs, etc.) edit `docker-compose.yml`:\n```\nenvironment:\n - TZ=Etc/UTC\n```\nwith any Timezone listed [here](https://en.wikipedia.org/wiki/List_of_tz_database_time_zones). Then run `sudo docker-compose stop ; sudo docker-compose up` after making changes.\n\n## SMTP\n\n### Retries\nThe `Settings -> SMTP -> Retries` denotes the number of times a message that fails at the moment of sending is retried silently using different connections from the SMTP pool. The messages that fail even after retries are the ones that are logged as errors and ignored.\n\n## SMTP ports\nSome server hosts block outgoing SMTP ports (25, 465). You may have to contact your host to unblock them before being able to send e-mails. Eg: [Hetzner](https://docs.hetzner.com/cloud/servers/faq/#why-can-i-not-send-any-mails-from-my-server).\n\n\n## Performance\n\n### Batch size\n\nThe batch size parameter is useful when working with very large lists with millions of subscribers for maximising throughput. It is the number of subscribers that are fetched from the database sequentially in a single cycle (~5 seconds) when a campaign is running. Increasing the batch size uses more memory, but reduces the round trip to the database.\n" }, { "path": "docs/docs/content/developer-setup.md", "content": "# Developer setup\nThe app has two distinct components, the Go backend and the VueJS frontend. In the dev environment, both are run independently.\n\n\n### Pre-requisites\n- `go`\n- `nodejs` (if you are working on the frontend) and `yarn`\n- Postgres database. If there is no local installation, the demo docker DB can be used for development (`docker compose up demo-db`)\n\n\n### First time setup\n`git clone https://github.com/knadh/listmonk.git`. The project uses go.mod, so it's best to clone it outside the Go src path.\n\n1. Copy `config.toml.sample` as `config.toml` and add your config.\n2. `make dist` to build the listmonk binary. Once the binary is built, run `./listmonk --install` to run the DB setup. For subsequent dev runs, use `make run`.\n\n> [mailhog](https://github.com/mailhog/MailHog) is an excellent standalone mock SMTP server (with a UI) for testing and dev.\n\n\n### Running the dev environment\nYou can run your dev environment locally or inside containers.\n\nAfter setting up the dev environment, you can visit `http://localhost:8080`.\n\n\n1. Locally\n\n - Run `make run` to start the listmonk dev server on `:9000`.\n - Run `make run-frontend` to start the Vue frontend in dev mode using yarn on `:8080`. All `/api/*` calls are proxied to the app running on `:9000`. Refer to the [frontend README](https://github.com/knadh/listmonk/blob/master/frontend/README.md) for an overview on how the frontend is structured.\n\n2. Inside containers (Using Makefile)\n\n - Run `make init-dev-docker` to setup container for db.\n - Run `make dev-docker` to setup docker container suite.\n - Run `make rm-dev-docker` to clean up docker container suite.\n\n3. Inside containers (Using devcontainer)\n\n - Open repo in vscode, open command palette, and select \"Dev Containers: Rebuild and Reopen in Container\".\n\nIt will set up db, and start frontend/backend for you.\n\n\n# Production build\nRun `make dist` to build the Go binary, build the Javascript frontend, and embed the static assets producing a single self-contained binary, `listmonk`\n" }, { "path": "docs/docs/content/external-integration.md", "content": "# Integrating with external systems\n\nIn many environments, a mailing list manager's subscriber database is not run independently but as a part of an existing customer database or a CRM. There are multiple ways of keeping listmonk in sync with external systems.\n\n## Using APIs\n\nThe [subscriber APIs](apis/subscribers.md) offers several APIs to manipulate the subscribers database, like addition, updation, and deletion. For bulk synchronisation, a CSV can be generated (and optionally zipped) and posted to the import API.\n\n## Interacting directly with the DB\n\nlistmonk uses tables with simple schemas to represent subscribers (`subscribers`), lists (`lists`), and subscriptions (`subscriber_lists`). It is easy to add, update, and delete subscriber information directly with the database tables for advanced usecases. See the [table schemas](https://github.com/knadh/listmonk/blob/master/schema.sql) for more information.\n" }, { "path": "docs/docs/content/i18n.md", "content": "# Internationalization (i18n)\n\nlistmonk comes available in multiple languages thanks to language packs contributed by volunteers. A language pack is a JSON file with a map of keys and corresponding translations. The bundled languages can be [viewed here](https://github.com/knadh/listmonk/tree/master/i18n).\n\n## Additional language packs\nThese additional language packs can be downloaded and passed to listmonk with the `--i18n-dir` flag as described in the next section.\n\n| Language | Description |\n|------------------|--------------------------------------|\n| [Deutsch (formal)](https://raw.githubusercontent.com/SvenPe/listmonk/4bbb2e5ebb2314b754cb2318f4f6683a0f854d43/i18n/de.json) | German language with formal pronouns |\n\n\n## Customizing languages\n\nTo customize an existing language or to load a new language, put one or more `.json` language files in a directory, and pass the directory path to listmonk with the`--i18n-dir=/path/to/dir` flag.\n\n\n## Contributing a new language\n\n### Using the basic editor\n\n- Visit [https://listmonk.app/i18n](https://listmonk.app/i18n)\n- Click on `Createa new language`, or to make changes to an existing language, use `Load language`.\n- Translate the text in the text fields on the UI.\n- Once done, use the `Download raw JSON` to download the language file.\n- Send a pull request to add the file to the [i18n directory on the GitHub repo](https://github.com/knadh/listmonk/tree/master/i18n). \n\n### Using InLang (external service)\n\n[](https://inlang.com/editor/github.com/knadh/listmonk?ref=badge)\n\n- Visit [https://inlang.com/editor/github.com/knadh/listmonk](https://inlang.com/editor/github.com/knadh/listmonk)\n- To make changes and push them, you need to log in to GitHub using OAuth and fork the project from the UI.\n- Translate the text in the input fields on the UI. You can use the filters to see only the necessary translations.\n- Once you're done, push the changes from the UI and click on \"Open a pull request.\" This will take you to GitHub, where you can write a PR message.\n" }, { "path": "docs/docs/content/index.md", "content": "# Introduction\n\n[](https://listmonk.app)\n\nlistmonk is a self-hosted, high performance one-way mailing list and newsletter manager. It comes as a standalone binary and the only dependency is a Postgres database.\n\n[](https://listmonk.app)\n\n## Developers\nlistmonk is a free and open source software licensed under AGPLv3. If you are interested in contributing, check out the [GitHub repository](https://github.com/knadh/listmonk) and refer to the [developer setup](developer-setup.md). The backend is written in Go and the frontend is Vue with Buefy for UI. \n" }, { "path": "docs/docs/content/installation.md", "content": "# Installation\n\nlistmonk is a simple binary application that requires a Postgres database instance to run. The binary can be downloaded and run manually, or it can be run as a container with Docker compose.\n\n## Binary\n1. Download the [latest release](https://github.com/knadh/listmonk/releases) and extract the listmonk binary. `amd64` is the main one. It works for Intel and x86 CPUs.\n1. `./listmonk --new-config` to generate config.toml. Edit the file.\n1. `./listmonk --install` to install the tables in the Postgres DB (⩾ 12).\n1. Run `./listmonk` and visit `http://localhost:9000` to create the Super Admin user and login.\n\n!!! Tip\n To set the Super Admin username and password during installation, set the environment variables:\n `LISTMONK_ADMIN_USER=myuser LISTMONK_ADMIN_PASSWORD=xxxxx ./listmonk --install`\n\n\n## Docker\n\nThe latest image is available on DockerHub at `listmonk/listmonk:latest`\n\nThe recommended method is to download the [docker-compose.yml](https://github.com/knadh/listmonk/blob/master/docker-compose.yml) file, customize it for your environment and then to simply run `docker compose up -d`.\n\n```shell\n# Download the compose file to the current directory.\ncurl -LO https://github.com/knadh/listmonk/raw/master/docker-compose.yml\n\n# Run the services in the background.\ndocker compose up -d\n```\n\nThen, visit `http://localhost:9000` to create the Super Admin user and login.\n\n!!! Tip\n To set the Super Admin username and password during setup, set the environment variables (only the first time):\n `LISTMONK_ADMIN_USER=myuser LISTMONK_ADMIN_PASSWORD=xxxxx docker compose up -d`\n\n\n### Mounting a custom config.toml\nThe docker-compose file includes all necessary listmonk configuration as environment variables, `LISTMONK_*`.\nIf you would like to remove those and mount a config.toml instead:\n\n#### 1. Save the config.toml file on the host\n\n```toml\n[app]\naddress = \"0.0.0.0:9000\"\n\n# Database.\n[db]\nhost = \"listmonk_db\" # Postgres container name in the compose file.\nport = 5432\nuser = \"listmonk\"\npassword = \"listmonk\"\ndatabase = \"listmonk\"\nssl_mode = \"disable\"\nmax_open = 25\nmax_idle = 25\nmax_lifetime = \"300s\"\n```\n\n#### 2. Mount the config file in docker-compose.yml\n\n```yaml\n app:\n ...\n volumes:\n - /path/on/your/host/config.toml:/listmonk/config.toml\n```\n\n#### 3. Change the `--config ''` flags in the `command:` section to point to the path\n\n```yaml\ncommand: [sh, -c, \"./listmonk --install --idempotent --yes --config /listmonk/config.toml && ./listmonk --upgrade --yes --config /listmonk/config.toml && ./listmonk --config /listmonk/config.toml\"]\n```\n\n-----------\n\n## Nightly\n\n!!! Warning\n Nightly releases are untested and may have bugs. Use at your own risk. Always take a backup of your Postgres database before using a nightly release.\n\nA nightly build is automatically published with the latest changes merged to the repository. If you want to access the latest changes without waiting for versioned releases, you can obtain the nightly builds and follow the same instructions above.\n\n- **Docker**: `listmonk/listmonk:nightly` (use this as the image name in the docker-compose file)\n- **Binary**: [Download nightly release](https://github.com/knadh/listmonk/releases/nightly)\n\n\n## Compiling from source\n\nTo compile the latest unreleased version (`master` branch):\n\n1. Make sure `go`, `nodejs`, and `yarn` are installed on your system.\n2. `git clone git@github.com:knadh/listmonk.git`\n3. `cd listmonk && make dist`. This will generate the `listmonk` binary.\n\n\n## Helm chart for Kubernetes\n\n  \n\nA helm chart for easily installing listmonk on a kubernetes cluster is made available by community [here](https://github.com/th0th/helm-charts/tree/main/charts/listmonk).\n\nIn order to use the helm chart, you can configure `values.yaml` according to your needs, and then run the following command:\n\n```shell\n$ helm upgrade \\\n --create-namespace \\\n --install listmonk listmonk \\\n --namespace listmonk \\\n --repo https://th0th.github.io/helm-charts \\\n --values values.yaml \\\n --version 0.1.0\n```\n\n## 3rd party hosting\n\n
![\"Deploy](\"https://raw.githubusercontent.com/elestio-examples/reactjs/refs/heads/master/src/deploy-on-elestio.png\")
\n\n
![\"Deploy](\"https://www.pikapods.com/static/run-button.svg\")
\n\n
![\"One-click](\"https://assets.northflank.com/deploy_to_northflank_smm_36700fb050.svg\")
\n\n
![\"One-click](\"https://railway.app/button.svg\")
\n\n
![\"Deploy](\"https://d16t0pc4846x52.cloudfront.net/deploy.png\")
\n\n
![\"Deploy](\"https://sealos.io/Deploy-on-Sealos.svg\")
\n\n
![\"Deploy](\"https://zeabur.com/button.svg\")
\n\n
![\"Install](\"https://cloudron.io/img/button.svg\")
\n\n## Tutorials\n* [Listmonk with Forward Email for Secure Newsletter Delivery](https://forwardemail.net/en/guides/newsletter-with-listmonk)\n* [Informal step-by-step on how to get started with listmonk using *Railway*](https://github.com/knadh/listmonk/issues/120#issuecomment-1421838533)\n* [Step-by-step tutorial for installation and all basic functions. *Amazon EC2, SES, docker & binary*](https://gist.github.com/MaximilianKohler/e5158fcfe6de80a9069926a67afcae11)\n* [Step-by-step guide on how to install and set up listmonk on *AWS Lightsail with docker* (rameerez)](https://github.com/knadh/listmonk/issues/1208)\n* [Quick setup on any cloud server using *docker and caddy*](https://github.com/samyogdhital/listmonk-caddy-reverse-proxy)\n* [*Binary* install on Ubuntu 22.04 as a service](https://mumaritc.hashnode.dev/how-to-install-listmonk-using-binary-on-ubuntu-2204)\n* [*Binary* install on Ubuntu 18.04 as a service (Apache & Plesk)](https://devgypsy.com/post/2020-08-18-installing-listmonk-newsletter-manager/)\n* [*Binary and docker* on linux (techviewleo)](https://techviewleo.com/manage-mailing-list-and-newsletter-using-listmonk/)\n* [*Binary* install on your PC](https://www.youtube.com/watch?v=fAOBqgR9Yfo). Discussions of limitations: [[1](https://github.com/knadh/listmonk/issues/862#issuecomment-1307328228)][[2](https://github.com/knadh/listmonk/issues/248#issuecomment-1320806990)].\n* [*Docker on Rocky Linux 8* (nginx, Let's Encrypt SSL)](https://wiki.crowncloud.net/?How_to_Install_Listmonk_with_Docker_on_Rocky_Linux_8)\n* [*Docker* with nginx reverse proxy, certbot SSL, and Gmail SMTP](https://www.maketecheasier.com/create-own-newsletter-with-listmonk/)\n* [Install Listmonk on Self-hosting with *Pre-Configured AMI Package at AWS* by Single Click](https://meetrix.io/articles/how-to-install-llama-2-on-aws-with-pre-configured-ami-package/)\n* [*Fly.io* working example](https://gitlab.com/votelog/apps/newsletter)\n"
},
{
"path": "docs/docs/content/maintenance/performance.md",
"content": "# Performance\n\nlistmonk is built to be highly performant and can handle millions of subscribers with minimal system resources.\n\nHowever, as the Postgres database grows—with a large number of subscribers, campaign views, and click records—it can significantly slow down certain aspects of the program, particularly in counting records and aggregating various statistics. For instance, loading admin pages that do these aggregations can take tens of seconds if the database has millions of subscribers.\n\n- Aggregate counts, statistics, and charts on the landing dashboard.\n- Subscriber count beside every list on the Lists page.\n- Total subscriber count on the Subscribers page.\n\nHowever, at that scale, viewing the exact number of subscribers or statistics every time the admin panel is accessed becomes mostly unnecessary. On installations with millions of subscribers, where the above pages do not load instantly, it is highly recommended to turn on the `Settings -> Performance -> Cache slow database queries` option.\n\n## Slow query caching\n\nWhen this option is enabled, the subscriber counts on the Lists page, the Subscribers page, and the statistics on the dashboard, etc., are no longer counted in real-time in the database. Instead, they are updated periodically and cached, resulting in a massive performance boost. The periodicity can be configured on the Settings -> Performance page using a standard crontab expression (default: `0 3 * * *`, which means 3 AM daily). Use a tool like [crontab.guru](https://crontab.guru) for easily generating a desired crontab expression.\n\n## VACUUM-ing\nRunning [`VACUUM ANALYZE`](https://www.postgresql.org/docs/current/sql-vacuum.html) on large Postgres databases at regular intervals (for instance, once a week), is recommended. It reclaims disk space and improves Postgres' query performance. Do note that this is a blocking operation and all database queries can come to a stand-still on a large database while the operation is running (generally only a few seconds).\n"
},
{
"path": "docs/docs/content/messengers.md",
"content": "# Messengers\n\nlistmonk supports multiple custom messaging backends in additional to the default SMTP e-mail backend, enabling not just e-mail campaigns, but arbitrary message campaigns such as SMS, FCM notifications etc.\n\nA *Messenger* is a web service that accepts a campaign message pushed to it as a JSON request, which the service can in turn broadcast as SMS, FCM etc. Messengers are registered in the *Settings -> Messengers* UI, and can be selected on individual campaigns.\n\nMessengers support optional BasicAuth authentication. `Plain text` format for campaign content is ideal for messengers such as SMS and FCM.\n\nWhen a campaign starts, listmonk POSTs messages in the following format to the selected messenger's endpoint. The endpoint should return a `200 OK` response in case of a successful request.\n\nThe address required to broadcast the message, for instance, a phone number or an FCM ID, is expected to be stored and relayed as [subscriber attributes](concepts.md/#attributes). \n\n```json\n{\n\t\"subject\": \"Welcome to listmonk\",\n\t\"body\": \"The message body\",\n\t\"content_type\": \"plain\",\n\t\"recipients\": [{\n\t\t\"uuid\": \"e44b4135-1e1d-40c5-8a30-0f9a886c2884\",\n\t\t\"email\": \"anon@example.com\",\n\t\t\"name\": \"Anon Doe\",\n\t\t\"attribs\": {\n\t\t\t\"phone\": \"123123123\",\n\t\t\t\"fcm_id\": \"2e7e4b512e7e4b512e7e4b51\",\n\t\t\t\"city\": \"Bengaluru\"\n\t\t},\n\t\t\"status\": \"enabled\"\n\t}],\n\t\"campaign\": {\n\t\t\"uuid\": \"2e7e4b51-f31b-418a-a120-e41800cb689f\",\n\t\t\"name\": \"Test campaign\",\n\t\t\"tags\": [\"test-campaign\"]\n\t}\n}\n```\n\n## Messenger implementations\n\nFollowing is a list of HTTP messenger servers that connect to various backends.\n\n| Name | Backend |\n|:-------------------------------------------------------------------------------------|:-----------------|\n| [listmonk-messenger](https://github.com/joeirimpan/listmonk-messenger) | AWS Pinpoint SMS |\n| [listmonk-verimor-gateway](https://github.com/antandros/listmonk-verimor-gateway) | Verimor |\n| [listmonk-mailersend](https://github.com/tkawczynski/listmonk-mailersend) | Mailersend |\n| [listmonk-novu-messenger](https://github.com/Codepowercode/listmonk-novu-messenger) | Novu |\n| [listmonk-push-messenger](https://github.com/shyamkrishna21/listmonk-push-messenger) | Google FCM |\n"
},
{
"path": "docs/docs/content/oidc.md",
"content": "\n## OIDC Single Sign On\n\nListmonk supports single sign-on with OIDC (OpenID Connect). Any standards compliant OIDC provider can be configured in Settings -> Security -> OIDC\n\n### User auto-creation\nIf `Settings -> Security -> OIDC -> Auto-create users` is turned on, when users login via OIDC, an account is auto-created if an existing account is not found (based on the OIDC e-mail ID).\n\n# Tutorials\n\nTutorials for configuring listmonk SSO with popular OIDC providers.\n\n## Keycloak\nKeycloak configuration for listmonk SSO integration.\n\n### 1. Create a new client in Keycloak\nIn the Keycloak admin, use an existing realm, or create a new realm. Create a new client in `Clients → Create`.\n\n- **General Settings**\n - **Client type**: `OpenID Connect`\n - **Client ID**: `listmonk` (or any preferred name)\n - **Name**: Optional descriptive name (e.g., \"listmonk SSO\")\n- **Capability Config**:\n - **Client authentication**: On\n - **Authorization**: On\n - **Authentication Flow**\n - **Standard Flow**: On\n - **Direct Access grants**: On\n- **Login Settings**:\n - **Root URL**: Copy the **Redirect URL for oAuth provider** value from listmonk Admin -> Settings -> Security -> OIDC. It will look like `https://listmonk.yoursite.com/auth/oidc`\n - **Valid redirect URIs**: Same as the Root URL above\n - **Valid post logout redirect URIs**: *\n\nAfter the client creation steps above, go to the client's `Credentials` tab and copy the `Client Secret`.\n\n### 2. Configure Listmonk\n2. In Listmonk Admin -> Settings -> Security -> OIDC.\n - **Enable OIDC SSO**: Turn on\n - **Provider URL**: `https://keycloak.yoursite.com/realms/{realm}` (replace `{realm}` with the chosen realm name). This URL is as of v26.3 and may differ across Keycloak versions.\n - **Provider name**: Set a name to show on the listmonk login form, eg: `Login with OrgName`\n - **Client ID**: Client ID set in Keycloak, eg: `listmonk`\n - **Client Secret**: Client Secret copied from Keycloak\n - **Auto-create users from SSO**: (Optional) Enable to automatically create users who don't exist\n - **Default user role**: (Required if auto-create enabled) Select role for new users\n\n\n\n## Authentik \nAuthentik configuration for listmonk SSO integration.\n\n### 1. Create a new OIDC provider in Authentik\nIn the Authentik admin interface, create a new OIDC provider for listmonk.\n\n- **Provider Settings**: \n - **Name**: `listmonk` (or any preferred name)\n - **Signing Key**: `authentik Self-signed Certificate`\n - **Client Type**: `Confidential`\n - **Client ID**: `listmonk` (or any preferred name)\n - **Redirect URIs**: Copy the **Redirect URL for oAuth provider** value from listmonk Admin -> Settings -> Security -> OIDC. It will look like `https://listmonk.yoursite.com/auth/oidc`\n\nAfter creating the provider, copy the **Client Secret**.\n\n### 2. Create an application in Authentik\nCreate a new application and connect it to the newly created provider.\n\n- **Application Settings**:\n - **Name**: `listmonk` (or any preferred name)\n - **Slug**: `listmonk` (or any preferred slug. Used in the redirect URL)\n - **Provider**: Select the OIDC provider created in the previous step\n\n### 3. Configure listmonk\nIn listmonk Admin → Settings → Security → OIDC:\n\n- **Enable OIDC SSO**: Turn on\n- **Provider URL**: `https://authentik.yoursite.com/application/o/{slug}/` (replace `{slug}` with the application's slug)\n- **Provider Name**: Set a name to show on the login form (e.g., `Login with OrgName`)\n- **Client ID**: Client ID set in Authentik (e.g., `listmonk`)\n- **Client Secret**: Client Secret copied from Authentik\n- **Auto-create users from SSO**: (Optional) Enable to automatically create users who don't exist\n- **Default user role**: (Required if auto-create enabled) Select role for new users\n\n## Google Workspace \nGoogle Workspace (Google Cloud) configuration for listmonk SSO integration.\n\n### 1. Create a new OIDC provider in Google Cloud Console / Google Workspace\nIn the Google Cloud Console interface, create a new Project.\n\n- **Project Settings**: \n - **Project name**: `Listmonk` (or any preferred name)\n- **Branding Settings**:\n - **App name**: `Listmonk` (or any preferred name, this will be visible to the users.)\n - **Authorised domains**: `listmonk.example.com` (or domains that your instance is available on.)\n\nAfter creating the project, goto **Clients**.\n\n### 2. Create an client in project.\nCreate a new client and configure it.\n\n- **Application Settings**:\n - **Application type**: `Web application`\n - **Name**: `listmonk` (or any preferred name)\n - **Authorised JavaScript origins**: `https://listmonk.example.com` (or domains that your instance is available on.)\n - **Authorised redirect URIs**: `https://listmonk.example.com/auth/oidc` (or domains that your instance is available on, value is also available in the Settings mentioned above. (Redirect URL for oAuth provider))\n\nHit save and note the Client ID and Client Secret\n\n### 3. Configure listmonk\nIn listmonk Admin → Settings → Security → OIDC:\n\n- **Enable OIDC SSO**: Turn on\n- **Provider URL**: `https://accounts.google.com` (select Google to Auto-Fill)\n- **Provider Name**: Set a name to show on the login form (e.g., `Login with OrgName`)\n- **Client ID**: Client ID copied from Console (e.g., `XXXX.apps.googleusercontent.com`)\n- **Client Secret**: Client Secret copied from Console\n- **Auto-create users from SSO**: (Optional) Enable to automatically create users who don't exist\n- **Default user role**: (Required if auto-create enabled) Select role for new users"
},
{
"path": "docs/docs/content/querying-and-segmentation.md",
"content": "# Querying and segmenting subscribers\n\nlistmonk allows the writing of partial Postgres SQL expressions to query, filter, and segment subscribers.\n\n## Database fields\n\nThese are the fields in the subscriber database that can be queried.\n\n| Field | Description |\n| ------------------------ | --------------------------------------------------------------------------------------------------- |\n| `subscribers.uuid` | The randomly generated unique ID of the subscriber |\n| `subscribers.email` | E-mail ID of the subscriber |\n| `subscribers.name` | Name of the subscriber |\n| `subscribers.status` | Status of the subscriber (`enabled`, `disabled`, `blocklisted`) |\n| `subscribers.attribs` | Map of arbitrary attributes represented as JSON. Accessed via the `->` and `->>` Postgres operator. |\n| `subscribers.created_at` | Timestamp when the subscriber was first added |\n| `subscribers.updated_at` | Timestamp when the subscriber was modified |\n\n## Sample attributes\n\nHere's a sample JSON map of attributes assigned to an imaginary subscriber.\n\n```json\n{\n \"city\": \"Bengaluru\",\n \"likes_tea\": true,\n \"spoken_languages\": [\"English\", \"Malayalam\"],\n \"projects\": 3,\n \"stack\": {\n \"frameworks\": [\"echo\", \"go\"],\n \"languages\": [\"go\", \"python\"],\n \"preferred_language\": \"go\"\n }\n}\n```\n\n\n\n## Sample SQL query expressions\n\n\n\n#### Find a subscriber by e-mail\n\n```sql\n-- Exact match\nsubscribers.email = 'some@domain.com'\n\n-- Partial match to find e-mails that end in @domain.com.\nsubscribers.email LIKE '%@domain.com'\n\n```\n\n#### Find a subscriber by name\n\n```sql\n-- Find all subscribers whose name start with John.\nsubscribers.email LIKE 'John%'\n\n```\n\n#### Multiple conditions\n\n```sql\n-- Find all Johns who have been blocklisted.\nsubscribers.email LIKE 'John%' AND subscribers.status = 'blocklisted'\n```\n\n#### Querying subscribers who viewed the campaign email\n\n```sql\n-- Find all subscribers who viewed the campaign email.\nEXISTS(SELECT 1 FROM campaign_views WHERE campaign_views.subscriber_id=subscribers.id AND campaign_views.campaign_id=**WARNING:**This permission allows execution of arbitrary SQL expressions and SQL functions. While it is readonly on the table data, it allows querying of all lists and subscribers directly from the database superceding individual list and subscriber permissions. Raw SQL expressions make it possible to obtain Postgres database configuration and potentially interact with other Postgres system features. Give this permission ONLY to trusted users. [Learn more](#subscriberssql_query). |\n| | tx:send | Send transactional messages to subscribers |\n| campaigns | campaigns:get | Get and view campaigns belonging to permitted lists |\n| | campaigns:get_all | Get and view campaigns across all lists |\n| | campaigns:get_analytics | Access campaign performance metrics |\n| | campaigns:manage | Create, update, and delete campaigns |\n| bounces | bounces:get | Get email bounce records |\n| | bounces:manage | Process and handle bounced emails |\n| | webhooks:post_bounce | Receive bounce notifications via webhook |\n| media | media:get | Get uploaded media files |\n| | media:manage | Upload, update, and delete media |\n| templates | templates:get | Get email templates |\n| | templates:manage | Create, update, and delete templates |\n| users | users:get | Get system user accounts |\n| | users:manage | Create, update, and delete user accounts **WARNING:**This permission allows creation of users with any role, including Super Admin. This permission should only be given to Super Admin level accounts |\n| | roles:get | Get user roles and permissions |\n| | roles:manage | Create and modify user roles |\n| settings | settings:get | Get system settings |\n| | settings:manage | Modify system configuration |\n| | settings:maintain | Perform system maintenance tasks |\n\n## List roles\n\nA list role is a collection of permissions assigned per list. Each list can be assigned a view (read) or manage (update) permission. List roles are attached to user accounts. Only the lists defined in a list role is accessible by the user, be it on the admin UI or via API calls. Do note that the `lists:get_all` and `lists:manage_all` permissions in user roles override all per-list permissions.\n\n## API users\n\nA user account can be of two types, a regular user or an API user. API users are meant for intertacting with the listmonk APIs programmatically. Unlike regular user accounts that have custom passwords or OIDC for authentication, API users get an automatically generated secret token.\n\n## `subscribers:sql_query`\n\nThis permission allowers users to write and execute arbitrary SQL queries on the database. Although it is executed as a read-only transaction disallowing changing of data in the database tables, it allows querying of all lists, subscribers and other data directly from the database superceding individual list and subscriber permissions.\n\nRaw SQL expressions also make it possible to obtain Postgres database configuration and potentially interact with other Postgres system features. Give this permission ONLY to trusted users.\n\nIf this permission is being assigned to many users, it is highly recommended that you create a custom Postgres role disallowing any privileged operations. For example:\n\n```sql\nCREATE ROLE listmonk_app WITH\n LOGIN\n PASSWORD '...'\n NOSUPERUSER\n NOCREATEDB\n NOCREATEROLE\n NOREPLICATION;\n```\n" }, { "path": "docs/docs/content/security-reports.md", "content": "If you spot a security vulnerability in listmonk, please report it via GitHub [security advisories](https://github.com/knadh/listmonk/security/advisories).\n### What not to report\n\nThe below listed scenarios are either not security vulnerabilities or are of acceptable risk. They keep getting reported unfortunately. Please refrain from doing so.\n\n### SQL injection via subscriber query\nThe subscribers UI (and APIs) support issuing of arbitrary SQL expressions via a `query` parameter. While listmonk ensures that the queries are executed as readonly and has basic checks for target tables to prevent accidental side-effects, it is not really possible to prevent arbitrary Turing-complete SQL expressions from calling various Postgres functions. Postgres itself does not offer an easy way to allow/disallow specific functions.\n\nThat's why this feature is behind a special permission `subscribers:sql_query` and its risks are [clearly documented](__https://listmonk.app/docs/roles-and-permissions/#user-roles__). In a multi-user scenario, it is up to an admin to allow this permission to trusted users.\n\n### Stored XSS via SVG\nIn addition to images, listmonk allows uploading of arbitrary file types, .html, .js, .svg, .* and does not transform or modify the files. That means, it is possible to have `\n\t\n