| Xenguy | fsmithred: That 'pstree' utility is a nice, easy-to-parse visualization of PC processes. Surprised I didn't run across that sooner. | 01:41 |
|---|---|---|
| Xenguy | Coincidentally I re-discovered 'tree' recently too | 01:42 |
| fsmithred | Xenguy, you know pgrep? | 02:04 |
| Xenguy | fsmithred: yes, pgrep and pkill come together I think | 02:11 |
| Xenguy | Very useful, and frequently used. Used to use 'ps aux |grep foo, or killall was popular too, before I came across pkill | 02:12 |
| Xenguy | Katolaz made me aware of pidof too | 02:13 |
| Xenguy | (through his conference presentation | 02:13 |
| Xenguy | ) | 02:13 |
| fsmithred | was trying to think of that one | 02:13 |
| Xenguy | minimalism was the theme of his talk, and I really enjoyed watching that (I liked the chocolates he was throwing too) | 02:14 |
| CAPTCHA_REQUIRED | Hi | 03:44 |
| CAPTCHA_REQUIRED | I'm getting quark: pthread_create: Resource temporarily unavailable when my system has more than enough resources available | 03:44 |
| CAPTCHA_REQUIRED | Why else could this happen? | 03:44 |
| CAPTCHA_REQUIRED | Here is the relevant syscalls | 03:45 |
| CAPTCHA_REQUIRED | clone(child_stack=NULL, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7f379e668a10) = 18629 | 03:45 |
| CAPTCHA_REQUIRED | wait4(-1, quark: pthread_create: Resource temporarily unavailable | 03:45 |
| CAPTCHA_REQUIRED | [{WIFEXITED(s) && WEXITSTATUS(s) == 1}], 0, NULL) = 18629 | 03:45 |
| gnarface | CAPTCHA_REQUIRED: probably some ulimit thing. check documentation on ulimit and /etc/security/limits.conf | 03:54 |
| CAPTCHA_REQUIRED | Im using stock limits | 03:56 |
| CAPTCHA_REQUIRED | However, I am using a kernel control group limit of 2G | 03:56 |
| CAPTCHA_REQUIRED | I've still got 1.7Gi available within this namespace only only 19 pids running inside of it, So I don't think it could be a memory thing | 03:57 |
| CAPTCHA_REQUIRED | Also, I'm only trying to create 4 threads | 03:58 |
| gnarface | how many files are you trying to open at once? | 03:58 |
| CAPTCHA_REQUIRED | Hmm | 03:58 |
| CAPTCHA_REQUIRED | Is there a way to tell that gnarface? | 03:58 |
| gnarface | this isn't something you wrote yourself? | 03:58 |
| CAPTCHA_REQUIRED | No | 03:59 |
| CAPTCHA_REQUIRED | Well | 03:59 |
| CAPTCHA_REQUIRED | Not mostly | 03:59 |
| CAPTCHA_REQUIRED | It's a kernel cgroup namespace of prosody, tor daemon (relay+directory), and quark | 03:59 |
| CAPTCHA_REQUIRED | Hmm | 04:00 |
| gnarface | what is the stock # of available file handles now? 4096 still? because that's not even enough to make wine or steam happy. | 04:00 |
| CAPTCHA_REQUIRED | file locks (-x) unlimited | 04:01 |
| gnarface | you can use lsof to check the open files count | 04:01 |
| gnarface | lsof | wc -l | 04:02 |
| gnarface | something like that | 04:02 |
| gnarface | or: lsof -p [pid] | 04:02 |
| CAPTCHA_REQUIRED | Yeah | 04:02 |
| gnarface | i think | 04:02 |
| CAPTCHA_REQUIRED | Oh looks like it's taking a while to populate | 04:02 |
| CAPTCHA_REQUIRED | Hey | 04:02 |
| CAPTCHA_REQUIRED | I do have a LOT of TCP sessions open | 04:02 |
| CAPTCHA_REQUIRED | For all the XMPP s2s connections and tor relays | 04:03 |
| gnarface | there are limits on tcp connection counts and amount of ram used by them | 04:03 |
| gnarface | check also /etc/sysctl.conf for that stuff | 04:03 |
| CAPTCHA_REQUIRED | Give me a sec it's trying to do rdns | 04:03 |
| CAPTCHA_REQUIRED | 1495 | 04:03 |
| CAPTCHA_REQUIRED | Oh wait | 04:04 |
| CAPTCHA_REQUIRED | Outside of the namespace | 04:04 |
| gnarface | hmm, i dunno but the kernel has some defaults to prevent processes from going off the rails and taking down the system, but sometimes if you have very high-end hardware they can strangle your throughput unless you adjust them a bit | 04:04 |
| CAPTCHA_REQUIRED | The lsof command failed printing lsof: no pwd entry for UID 1000 | 04:04 |
| CAPTCHA_REQUIRED | and lsof: no pwd entry for UID 999 | 04:04 |
| CAPTCHA_REQUIRED | over and over again | 04:04 |
| CAPTCHA_REQUIRED | Then returned 31219 | 04:04 |
| gnarface | and if you're using a virtualization container of some sort then that can cause extra complications between the guest and host's limits | 04:05 |
| CAPTCHA_REQUIRED | I'm using lxc | 04:05 |
| gnarface | i could almost have guessed that | 04:05 |
| gnarface | note that there are both hard and soft limits with different defaults | 04:06 |
| CAPTCHA_REQUIRED | Just to be clear gnarface you don't think it's a thread limit, but somehow my system has run out of file descriptors | 04:07 |
| CAPTCHA_REQUIRED | And I need to find out what is taking all my descriptors, or increase the limit | 04:08 |
| gnarface | CAPTCHA_REQUIRED: well there's a bunch of limits and i'm just guessing it might be one of them, not necessarily the file descriptor one, but that one is the one i ran into troubles with the most, so it was my first guess | 04:08 |
| gnarface | note that if you're using lxc, there might be situations where you have to adjust the limits for both the host and the guest | 04:09 |
| gnarface | i'm not very familiar with lxc, but it's unlikely the host for a proper virtualization solution would allow it's guest's limits to exceed it's own | 04:09 |
| CAPTCHA_REQUIRED | If i was exceeding a limit would it show up in a log somewhere? | 04:10 |
| gnarface | probably, but the error you pasted was sufficient for google to corroborate my hypothesis | 04:11 |
| gnarface | you can also manually check each limit with the ulimit tool | 04:11 |
| gnarface | (try it and note that you'll get different responses depending on whether you're in our out of the guest, whether you're root or not, and whether you're ssh'd or on a physically local terminal or not) | 04:12 |
| gnarface | (and don't forget to check both hard and soft limits) | 04:12 |
| CAPTCHA_REQUIRED | » ~# lsof 2>/dev/null | wc -l | 04:13 |
| CAPTCHA_REQUIRED | » 31188 | 04:13 |
| CAPTCHA_REQUIRED | This is from the host | 04:14 |
| CAPTCHA_REQUIRED | I had to redirect stderr because the uids were subuids | 04:14 |
| gnarface | you gotta constrain that by individual process | 04:14 |
| CAPTCHA_REQUIRED | Hmm | 04:14 |
| CAPTCHA_REQUIRED | fs.file-max = 401614 | 04:15 |
| gnarface | try: lsof -p [pid of guest] | 04:15 |
| CAPTCHA_REQUIRED | I don't think it works like that gnarf | 04:15 |
| fluffywolf | trying new versions of things after the beowulf upgrade... gimp's tool icons seem to be broken. they're light grey shapes that are essentially invisible, and are the same no matter which of the four themes I pick. | 04:16 |
| CAPTCHA_REQUIRED | The entire ptree is exposed to the hos | 04:16 |
| CAPTCHA_REQUIRED | T | 04:16 |
| CAPTCHA_REQUIRED | Unless you mean pid of guest's init | 04:16 |
| fluffywolf | nevermind. changing icon themes fixed it. apparantly the default is "invisible". | 04:16 |
| fluffywolf | ... | 04:16 |
| CAPTCHA_REQUIRED | There's only one thing that concerns me lxc.cgroup.memory.limit_in_bytes = 2G | 04:18 |
| CAPTCHA_REQUIRED | Memory use: 820.73 MiB | 04:19 |
| CAPTCHA_REQUIRED | KMem use: 28.78 MiB | 04:19 |
| gnarface | CAPTCHA_REQUIRED: sorry i don't know enough about lxc | 04:19 |
| CAPTCHA_REQUIRED | No worries | 04:19 |
| gnarface | i'm relatively certain i've put you on the right path, but closing the loop is gonna require reading some documentation about the matter | 04:19 |
| CAPTCHA_REQUIRED | Yeah | 04:21 |
| CAPTCHA_REQUIRED | Well | 04:21 |
| CAPTCHA_REQUIRED | I get the error on the host too | 04:21 |
| CAPTCHA_REQUIRED | p# /var/tmp/quark -p 80 -h :: -u www-data -g www-data -d /usr/share/vim | 04:21 |
| CAPTCHA_REQUIRED | /var/tmp/quark: pthread_create: Resource temporarily unavailable | 04:21 |
| gnarface | fluffywolf: maybe related, maybe not but a long time before beowulf i ran into a problem with the default icon themes not having icons which manifested in that basic way. i installed tango-icon-theme and put gtk-icon-theme-name="Tango" in my ~/.gtkrc-2.0.mine | 04:21 |
| CAPTCHA_REQUIRED | Maybe it's a problem with the code | 04:21 |
| gnarface | i would look for it opening stuff in a loop but not closing it after | 04:22 |
| gnarface | but if this is online, this can also be caused by incoming network connections | 04:22 |
| CAPTCHA_REQUIRED | Yeah it was a problem with the code | 04:23 |
| CAPTCHA_REQUIRED | I went back to an earlier revision | 04:23 |
| CAPTCHA_REQUIRED | Before threading was implemented | 04:23 |
| gnarface | huh, is it perl? | 04:24 |
| CAPTCHA_REQUIRED | » <gnarface> but if this is online, this can also be caused by incoming network connections | 04:24 |
| CAPTCHA_REQUIRED | can you elaborate? It's been a while since I had to tune a linux kernel for lots of long-sustained TCP sessions | 04:24 |
| CAPTCHA_REQUIRED | gnarface: no it's just C | 04:24 |
| gnarface | well, like i said, there's other limits, not just on number of open files | 04:24 |
| CAPTCHA_REQUIRED | gnarface: here is the source https://git.suckless.org/quark/ | 04:25 |
| gnarface | some of them are in the kernel sysctl.conf | 04:25 |
| gnarface | now it is a known type of attack for public facing servers to be DOS'd by simply exhausting the available network connections | 04:25 |
| gnarface | clients will just find some service that responds by opening a connection and waits politely to close, then they just don't close it | 04:25 |
| gnarface | then they open more | 04:26 |
| gnarface | in a loop | 04:26 |
| gnarface | if they don't care about a valid response then it doesn't matter that the connection hangs | 04:26 |
| gnarface | all they care about is using up the available connections faster than the timeout clears them | 04:27 |
| gnarface | it's usually easier to deal with these vandals at the firewall level though | 04:27 |
| CAPTCHA_REQUIRED | Yeah i've dealt with those in the past | 04:36 |
| CAPTCHA_REQUIRED | Usually they aren't very smart about it and do the synflood from a singal ip range | 04:37 |
| CAPTCHA_REQUIRED | Which is easier enough to filter out with a bucket | 04:37 |
| unixbsd | does the Linux kernel of devuan on AMD64 (testing or sid) read the UFS A6 FS format of openbsd? | 10:45 |
| gnarface | unixbsd: yes, but the module might not have auto-loaded for you | 11:20 |
| gnarface | oh, well i dunno about "A6" specifically, whatever that is | 11:20 |
| gnarface | i would say modprobe ufs and try it | 11:21 |
| apollo__ | how would I go about finding out what processes are altering /proc/sys/vm/{dirty_background_bytes,dirty_bytes} and their friends? about once a week or so they get set to 0 which makes a mess for usb thumbdrives. | 15:05 |
| gnarface | fuser maybe? | 15:06 |
| apollo__ | gnarface, that would works if something was writing to the files continuously. but it just exits if nothing is accessing the file /right now/. | 15:13 |
| apollo__ | i mean, i could set up a cron to check the values every minute (i already have it set to write sane values in rc.local on boot), but that seems a hopeless throw-your-hands-in-the-air workaround rather than a i-know-whats-happening-here solution | 15:15 |
| gnarface | hmmm, maybe check out systraq or tripwire | 15:17 |
| gnarface | there's also inotify or dnotify but i think those are the type of things you gotta write code to use | 15:17 |
| apollo__ | gnarface, thanks for the hints, checking... | 15:49 |
| DPA | Maybe auditd could help with that. | 15:59 |
| mason | unixbsd: Worst case, you can run a VM that can access your UFS. Remember that UFS is years past meaning just one filesystem, so universal support is harder and harder. | 16:21 |
| unixbsd | Hello, which software allows to modify a PDF documents, with adding Gifs, Png,... or Text on it, to be annotated? | 21:11 |
| djph | unixbsd: generally one would write some form of sourcecode document (e.g. LaTeX or LO) and then let that compile the PDF | 21:17 |
| unixbsd | I would like to add little text on the document, on each page. Of courses, doing with latex, would be nicely possible. I guess to add a y,x Text on it, at given fixed absolute position might be possible somehow. | 21:18 |
| djph | I mean, there are also paid-for editors if the only "source" you have is an already-compiled PDF. | 21:19 |
| specing | unixbsd: mupdf, probably | 21:20 |
| unixbsd | Sure, I have only a source : PDF (compiled, and only this). | 21:20 |
| unixbsd | mupdf has not editing capability, it is only a viewer. | 21:20 |
| onefang | LibreOffice, maybe GIMP. | 21:22 |
| unixbsd | I didnt know that libreoffice would edit PDF documents (here about 30-40 pages). | 21:23 |
| onefang | I vaguely recall that it does. | 21:24 |
| unixbsd | actually your idea to use pdfpages{ page ... = 1,... 30} + use x,y editing thing on the pdf (each pages), then run pdflatex might be interesting output. | 21:25 |
| unixbsd | it is however bit hard, I cannot recall how to place text or png at a given position using tex | 21:29 |
| aitor_ | unixbsd: i did something in the past using the haru library | 22:22 |
| aitor_ | http://libharu.org/ | 22:22 |
| rwp | unixbsd, I have a client using a commercial bit of software for filling in parts like gifs and things. But recently I was looking for a replacement and I think pdftk will do the same thing. | 22:23 |
| rwp | I have used pdftk a lot for other things and it is on my short list to go investigate using it to fill in pdf forms and to insert graphs and things. | 22:24 |
| rwp | aitor_, I haven't heard of haru before but I am adding it to my list to go look at! | 22:24 |
| rwp | Is haru packaged? One advantage of pdftk is that it is already packaged and available for installation. | 22:25 |
| rwp | It looks like libharu is all about generating pdf files. Is that right? My need, different from unixbsd I am sure, is to generate a pretty report in pdf format with portions filled in. | 22:26 |
| aitor_ | nope, as far as i know, but i did it in the past | 22:26 |
| aitor_ | libharu doesn't support reading and editing existing pdf files so far, but you can generate a new one and combine the result with an existing one using the pdftk toolkit | 22:26 |
| aitor_ | i did .deb packages a few years ago, and started working on some C libraries | 22:27 |
| aitor_ | c++, better said, but i abandoned the work | 22:28 |
| aitor_ | it might be interesting to take it up again | 22:30 |
| rwp | PDF has this concept of tagged fields that then can have objects stuffed into them later. | 22:31 |
| rwp | This allows someone relatively unskilled to generate a PDF template and then have it filled in later such as in a web page generating a report. | 22:31 |
| rwp | But almost everything about PDFs are ten times harder than they should be because of the Adobe nature of PDF. I wish there were something better. Like plain text! | 22:32 |
| unixbsd | onefang: I have modified the mupdf project, compiled it, and now it can show the position x,y. https://gitlab.com/openbsd98324/mupdf | 22:32 |
| unixbsd | then, I run pdlatex with the package: texblock* so that I can place at x,y the box or text, or even imaage on the top of pdf (pdfpage or wallpaper background pdf). | 22:33 |
| aitor_ | unixbsd, that's interesting! | 22:34 |
| unixbsd | really,? It is just little bit of C and tex. nothing else. | 22:34 |
| aitor_ | little things give ideas :) | 22:35 |
| unixbsd | aitor_: please find herewith the little source code, url: https://termbin.com/mbbf since it interests you. | 22:56 |
| aitor_ | thanks, i'll take a look | 22:57 |
| aitor_ | rwp: *nope, as far as i know, but i did it in the past* <-- I was referring to the existence of the packages. haru is not packaged | 23:31 |
Generated by irclog2html.py 2.17.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!