OS Partition full. I made room, but FrontView and SSH broke

[cryptyk]

So my NAS started getting wonky and frontview stopped responding and SSH was refusing connections. I started by doing an OS reinstall, but that made it so FrontView wouldn't load at all. I did some searches and saw that the OS partition was likely full.
I telnetted in via the tech support menu and sure enough the OS partition was 100% full. I cleaned up some log files and rebooted. Now, I'm still "stuck" in the place where frontview and SSH fail to load even though there's plenty of room on the OS partition. I tried to OS resintall again, but no luck.

Here's the last bits of the error log:

[Tue Dec 02 06:30:50 2014] [error] [client 127.0.0.1] File does not exist: /frontview/ui/resource/html[Wed Dec 03 06:25:14 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Wed D[Fri Dec 05 19:54:31 2014] [warn] pid file /var/log/frontview/apache-ssl.pid overwritten -- Unclean shutdown of previous Apache run?
[Fri Dec 05 19:54:31 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Fri Dec 05 19:54:39 2014] [notice] Graceful restart requested, doing restart
[Fri Dec 05 19:54:40 2014] [warn] Useless use of AllowOverride in line 5.
apache-ssl: Could not reliably determine the server's fully qualified domain name, using 192.168.2.193 for ServerName
[Fri Dec 05 19:54:42 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Fri Dec 05 19:55:38 2014] [notice] Graceful restart requested, doing restart
[Fri Dec 05 19:55:40 2014] [warn] Useless use of AllowOverride in line 5.
apache-ssl: Could not reliably determine the server's fully qualified domain name, using 192.168.2.193 for ServerName
[Fri Dec 05 19:55:43 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Sat Dec 06 06:25:14 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Sat Dec 06 12:43:14 2014] [error] [client 192.168.2.212] File does not exist: /frontview/ui/resource/html/images, referer: https://192.168.2.193/admin/
iconv: error while closing output file: No space left on device
[Sat Dec 06 13:12:11 2014] [error] [client 192.168.2.212] AuthExtern pwauth [/usr/bin/pwauth]: Failed (1) for user admin, referer: https://192.168.2.193/admin/
[Sat Dec 06 13:12:11 2014] [error] [client 192.168.2.212] user admin: authentication failure for "/get_handler/": Password Mismatch, referer: https://192.168.2.193/admin/
[Sat Dec 06 13:13:15 2014] [notice] caught SIGTERM, shutting down
[Sat Dec 06 13:18:05 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Sat Dec 06 13:18:08 2014] [notice] Graceful restart requested, doing restart
[Sat Dec 06 13:18:09 2014] [warn] Useless use of AllowOverride in line 5.
apache-ssl: Could not reliably determine the server's fully qualified domain name, using 192.168.2.193 for ServerName
[Sat Dec 06 13:18:10 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Sat Dec 06 15:04:01 2014] [error] [client 192.168.2.212] AuthExtern pwauth [/usr/bin/pwauth]: Failed (1) for user admin
[Sat Dec 06 15:04:01 2014] [error] [client 192.168.2.212] user admin: authentication failure for "/admin/": Password Mismatch
[Sun Dec 07 06:25:09 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
df: `/d': No such file or directory
df: `/e': No such file or directory
df: `/f': No such file or directory
du: cannot read directory `/c/home/guest': Permission denied
du: cannot read directory `/c/home/admin/.AppleDesktop': Permission denied
du: cannot read directory `/c/home/admin/Temporary Items': Permission denied
du: cannot read directory `/c/home/admin/Network Trash Folder': Permission denied
du: cannot read directory `/c/home/Temporary Items': Permission denied
du: cannot read directory `/c/home/Network Trash Folder': Permission denied
du: cannot read directory `/c/lost+found': Permission denied
du: cannot read directory `/c/.timemachine/SDGL122c13c10.sparsebundle': Permission denied
du: cannot access `/d': No such file or directory
du: cannot access `/e': No such file or directory
du: cannot access `/f': No such file or directory
[Mon Dec 08 06:25:08 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Tue Dec 09 06:25:08 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Wed Dec 10 06:25:15 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Wed Dec 10 19:29:38 2014] [error] [client 192.168.2.212] client denied by server configuration: /c/media/owncloud/, referer: http://192.168.2.193/shares/
[Wed Dec 10 20:12:00 2014] [notice] caught SIGTERM, shutting down
[Wed Dec 10 20:13:29 2014] [notice] Apache/2.2.6 (Debian) mod_ssl/2.2.6 OpenSSL/0.9.8c DAV/2 mod_scgi/1.11 PHP/5.3.20-0rnx1 mod_apreq2-20051231/2.6.0 mod_perl/2.0.2 Perl/v5.8.8 configured -- resuming normal operations
[Wed Dec 10 20:14:34 2014] [notice] caught SIGTERM, shutting down

What should I check next?

Thanks!
c

[mdgm-ntgr]

Some config files may be corrupt or blank e.g. /etc/default/services

[cryptyk]

Thanks. What's the best way to reconstitute those, short of a factory reset? OS Reinstall isn't doing it. Is there a way to upload a firmware from the laptop and force it to fresh install without wiping my data partitions?

Thanks for the help. You're a god on these forums 🙂

[mdgm-ntgr]

Well if you had SSH access you could have tried e.g.:

# cp -pf /etc/default/config/etc/default/services /etc/default/services
# echo "APACHESSL=1" > /etc/default/services
# echo "SSH=1" > /etc/default/services

[eteng65]

OK， I will have a try, if there is any problem, can I ask you again?

[cryptyk]

mdgm wrote:
Well if you had SSH access you could have tried e.g.: # cp -pf /etc/default/config/etc/default/services /etc/default/services # echo "APACHESSL=1" > /etc/default/services # echo "SSH=1" > /etc/default/services

THANK YOU!!!

I still had tech support telnet access to the box. I mounted the os partition, then ran the above (slightly modified because tech support partition was mounted as the root).

Now I have SSH access, but it looks like apache (frontview) isn't starting. I can probably debug it from here, but if there's a similar cp -R <source> <target> command that will put most of the OS back in place, that would be awesome.

Thanks again!

[cryptyk]

Nevermind. Now that SSH is up and running, I can see what's going on at boot. It looks like the OS Reinstall wiped out some of the things I needed (like Apache SCGIMount) that make my addons work. I just need to go get the system back to where I had it and I think FrontView will launch.

Thanks so much for the help!

[cryptyk]

...and I got frontview back up and running. Thanks for getting me unstuck!