HTTP Distribution Point - not working

[tuinte]

Hey all:

I'm new to the scene so please be understanding if this is basic stuff.

I had an HTTP Distribution Point working from a Mac mini running 10.8 Server (the same one running JSS and everything else Casper). It was working fine but I was asked to RAID1 the mini sever's internal drives. So I Carbon Copy Cloned the whole thing to an external, RAIDed the drives, Carbon Copy Cloned everything back.

I booted back up and DHCP took over and assigned an IP, which sort of broke everything, but I reset up the IP and DNS, then re-ran the JSS installer, and everything was back up - except for the HTTP Distribution Point. The error when running a policy is this:

/usr/sbin/jamf is version 8.63 Executing Policy Test (HTTP)... [STEP 1 of 1] Creating directory structure for /Library/Application Support/JAMF/Downloads/ Downloading http://SERVER.ca:80/CasperShare/Scripts/_DisplayMessage.sh... Error running script: The script could not be found on the server..

When I click "View Server Website" in the Websites pane of Server.app, I get the It Works! page, so that's cool. But if I browse to http://192.168.x.x I don't get the folder index I used to. I assume this is where the break is, so nothing particularly to do with Casper, but you guys are so helpful.

Any tips on where to look?

Thanks in advance for any help.

Michael

[jarednichols]

First things first... register your server with your DNS infrastructure and get an IP that doesn't change. Either static or reserve it in DHCP with the system's MAC address.

Second, use the FQDN of your server and not the IP. You'll thank me later.

Third, not getting the folder index isn't necessarily the problem. Generally you don't want your CasperShare to be browsable to begin with as it leaves all your packages out in the open. You want them explicitly stated by your clients.

I'm guessing AFP/SMB works ok?

Can you copy in your httpd.conf file so we can have a look?

[tuinte]

Thanks so much for the help.

The server has a static IP, but when booted up after the clone, DHCP was on (not sure why). It is now running with a static IP again.

AFP is working fine.

The httpd.conf file at /private/etc/apache2/ is rather long and doesn't seem to contain any non-default information. Is there another httpd.conf file somewhere? I can paste the contents of this one if you'd like. I really do appreciate this.

[tuinte]

Here, I'll paste /private/etc/apache2/httpd.conf regardless:

#
# This is the main Apache HTTP server configuration file. It contains the
# configuration directives that give the server its instructions.
# See <URL:http://httpd.apache.org/docs/2.2> for detailed information.
# In particular, see # <URL:http://httpd.apache.org/docs/2.2/mod/directives.html>
# for a discussion of each configuration directive.
#
# Do NOT simply read the instructions in here without understanding
# what they do. They're here only as hints or reminders. If you are unsure
# consult the online docs. You have been warned. #
# Configuration and logfile names: If the filenames you specify for many
# of the server's control files begin with "/" (or "drive:/" for Win32), the
# server will use that explicit path. If the filenames do *not* begin
# with "/", the value of ServerRoot is prepended -- so "log/foo_log"
# with ServerRoot set to "/usr" will be interpreted by the
# server as "/usr/log/foo_log".

#
# ServerRoot: The top of the directory tree under which the server's
# configuration, error, and log files are kept.
#
# Do not add a slash at the end of the directory path. If you point
# ServerRoot at a non-local disk, be sure to point the LockFile directive
# at a local disk. If you wish to share the same ServerRoot for multiple
# httpd daemons, you will need to change at least LockFile and PidFile.
#
ServerRoot "/usr"

#
# Listen: Allows you to bind Apache to specific IP addresses and/or
# ports, instead of the default. See also the <VirtualHost>
# directive.
#
# Change this to Listen on specific IP addresses as shown below to # prevent Apache from glomming onto all bound IP addresses.
#
#Listen 12.34.56.78:80
Listen 80

#
# Dynamic Shared Object (DSO) Support
#
# To be able to use the functionality of a module which was built as a DSO you
# have to place corresponding `LoadModule' lines at this location so the
# directives contained in it are actually available before they are used.
# Statically compiled modules (those listed by `httpd -l') do not need
# to be loaded here.
#
# Example:
# LoadModule foo_module modules/mod_foo.so
#
LoadModule authn_file_module libexec/apache2/mod_authn_file.so
LoadModule authn_dbm_module libexec/apache2/mod_authn_dbm.so
LoadModule authn_anon_module libexec/apache2/mod_authn_anon.so
LoadModule authn_dbd_module libexec/apache2/mod_authn_dbd.so
LoadModule authn_default_module libexec/apache2/mod_authn_default.so
LoadModule authz_host_module libexec/apache2/mod_authz_host.so
LoadModule authz_groupfile_module libexec/apache2/mod_authz_groupfile.so
LoadModule authz_user_module libexec/apache2/mod_authz_user.so
LoadModule authz_dbm_module libexec/apache2/mod_authz_dbm.so
LoadModule authz_owner_module libexec/apache2/mod_authz_owner.so
LoadModule authz_default_module libexec/apache2/mod_authz_default.so
LoadModule auth_basic_module libexec/apache2/mod_auth_basic.so
LoadModule auth_digest_module libexec/apache2/mod_auth_digest.so
LoadModule cache_module libexec/apache2/mod_cache.so
LoadModule disk_cache_module libexec/apache2/mod_disk_cache.so
LoadModule mem_cache_module libexec/apache2/mod_mem_cache.so
LoadModule dbd_module libexec/apache2/mod_dbd.so
LoadModule dumpio_module libexec/apache2/mod_dumpio.so
LoadModule reqtimeout_module libexec/apache2/mod_reqtimeout.so
LoadModule ext_filter_module libexec/apache2/mod_ext_filter.so
LoadModule include_module libexec/apache2/mod_include.so
LoadModule filter_module libexec/apache2/mod_filter.so
LoadModule substitute_module libexec/apache2/mod_substitute.so
LoadModule deflate_module libexec/apache2/mod_deflate.so
LoadModule log_config_module libexec/apache2/mod_log_config.so
LoadModule log_forensic_module libexec/apache2/mod_log_forensic.so
LoadModule logio_module libexec/apache2/mod_logio.so
LoadModule env_module libexec/apache2/mod_env.so
LoadModule mime_magic_module libexec/apache2/mod_mime_magic.so
LoadModule cern_meta_module libexec/apache2/mod_cern_meta.so
LoadModule expires_module libexec/apache2/mod_expires.so
LoadModule headers_module libexec/apache2/mod_headers.so
LoadModule ident_module libexec/apache2/mod_ident.so
LoadModule usertrack_module libexec/apache2/mod_usertrack.so
#LoadModule unique_id_module libexec/apache2/mod_unique_id.so
LoadModule setenvif_module libexec/apache2/mod_setenvif.so
LoadModule version_module libexec/apache2/mod_version.so
LoadModule proxy_module libexec/apache2/mod_proxy.so
LoadModule proxy_connect_module libexec/apache2/mod_proxy_connect.so
LoadModule proxy_ftp_module libexec/apache2/mod_proxy_ftp.so
LoadModule proxy_http_module libexec/apache2/mod_proxy_http.so
LoadModule proxy_scgi_module libexec/apache2/mod_proxy_scgi.so
LoadModule proxy_ajp_module libexec/apache2/mod_proxy_ajp.so
LoadModule proxy_balancer_module libexec/apache2/mod_proxy_balancer.so
LoadModule ssl_module libexec/apache2/mod_ssl.so
LoadModule mime_module libexec/apache2/mod_mime.so
LoadModule dav_module libexec/apache2/mod_dav.so
LoadModule status_module libexec/apache2/mod_status.so
LoadModule autoindex_module libexec/apache2/mod_autoindex.so
LoadModule asis_module libexec/apache2/mod_asis.so
LoadModule info_module libexec/apache2/mod_info.so
LoadModule cgi_module libexec/apache2/mod_cgi.so
LoadModule dav_fs_module libexec/apache2/mod_dav_fs.so
LoadModule vhost_alias_module libexec/apache2/mod_vhost_alias.so
LoadModule negotiation_module libexec/apache2/mod_negotiation.so
LoadModule dir_module libexec/apache2/mod_dir.so
LoadModule imagemap_module libexec/apache2/mod_imagemap.so
LoadModule actions_module libexec/apache2/mod_actions.so
LoadModule speling_module libexec/apache2/mod_speling.so
LoadModule userdir_module libexec/apache2/mod_userdir.so
LoadModule alias_module libexec/apache2/mod_alias.so
LoadModule rewrite_module libexec/apache2/mod_rewrite.so
#LoadModule perl_module libexec/apache2/mod_perl.so
#LoadModule php5_module libexec/apache2/libphp5.so
#LoadModule hfs_apple_module libexec/apache2/mod_hfs_apple.so

<IfModule !mpm_netware_module>
<IfModule !mpm_winnt_module>
#
# If you wish httpd to run as a different user or group, you must run
# httpd as root initially and it will switch. #
# User/Group: The name (or #number) of the user/group to run httpd as.
# It is usually good practice to create a dedicated user and group for
# running httpd, as with most system services.
#
User _www
Group _www

</IfModule>
</IfModule>

# 'Main' server configuration
#
# The directives in this section set up the values used by the 'main'
# server, which responds to any requests that aren't handled by a
# <VirtualHost> definition. These values also provide defaults for
# any <VirtualHost> containers you may define later in the file.
#
# All of these directives may appear inside <VirtualHost> containers,
# in which case these default settings will be overridden for the
# virtual host being defined.
#

#
# ServerAdmin: Your address, where problems with the server should be
# e-mailed. This address appears on some server-generated pages, such
# as error documents. e.g. admin@your-domain.com
#
ServerAdmin you@example.com

#
# ServerName gives the name and port that the server uses to identify itself.
# This can often be determined automatically, but we recommend you specify
# it explicitly to prevent problems during startup.
#
# If your host doesn't have a registered DNS name, enter its IP address here.
#
#ServerName www.example.com:80

#
# DocumentRoot: The directory out of which you will serve your
# documents. By default, all requests are taken from this directory, but
# symbolic links and aliases may be used to point to other locations.
#
DocumentRoot "/Library/WebServer/Documents"

#
# Each directory to which Apache has access can be configured with respect
# to which services and features are allowed and/or disabled in that
# directory (and its subdirectories). #
# First, we configure the "default" to be a very restrictive set of # features. #
<Directory /> Options FollowSymLinks AllowOverride None Order deny,allow Deny from all
</Directory>

#
# Note that from this point forward you must specifically allow
# particular features to be enabled - so if something's not working as
# you might expect, make sure that you have specifically enabled it
# below.
#

#
# This should be changed to whatever you set DocumentRoot to.
#
<Directory "/Library/WebServer/Documents"> # # Possible values for the Options directive are "None", "All", # or any combination of: # Indexes Includes FollowSymLinks SymLinksifOwnerMatch ExecCGI MultiViews # # Note that "MultiViews" must be named *explicitly* --- "Options All" # doesn't give it to you. # # The Options directive is both complicated and important. Please see # http://httpd.apache.org/docs/2.2/mod/core.html#options # for more information. # Options Indexes FollowSymLinks MultiViews

# # AllowOverride controls what directives may be placed in .htaccess files. # It can be "All", "None", or any combination of the keywords: # Options FileInfo AuthConfig Limit # AllowOverride None

# # Controls who can get stuff from this server. # Order allow,deny Allow from all

</Directory>

#
# DirectoryIndex: sets the file that Apache will serve if a directory
# is requested.
#
<IfModule dir_module> DirectoryIndex index.html
</IfModule>

#
# The following lines prevent .htaccess and .htpasswd files from being # viewed by Web clients. #
<FilesMatch "^.([Hh][Tt]|[Dd][Ss]_[Ss])"> Order allow,deny Deny from all Satisfy All
</FilesMatch>

#
# Apple specific filesystem protection.
#
<Files "rsrc"> Order allow,deny Deny from all Satisfy All
</Files>
<DirectoryMatch ".*..namedfork"> Order allow,deny Deny from all Satisfy All
</DirectoryMatch>

#
# ErrorLog: The location of the error log file.
# If you do not specify an ErrorLog directive within a <VirtualHost>
# container, error messages relating to that virtual host will be
# logged here. If you *do* define an error logfile for a <VirtualHost>
# container, that host's errors will be logged there and not here.
#
ErrorLog "/private/var/log/apache2/error_log"

#
# LogLevel: Control the number of messages logged to the error_log.
# Possible values include: debug, info, notice, warn, error, crit,
# alert, emerg.
#
LogLevel warn

<IfModule log_config_module> # # The following directives define some format nicknames for use with # a CustomLog directive (see below). # LogFormat "%h %l %u %t "%r" %>s %b "%{Referer}i" "%{User-Agent}i"" combined LogFormat "%h %l %u %t "%r" %>s %b" common

<IfModule logio_module> # You need to enable mod_logio.c to use %I and %O LogFormat "%h %l %u %t "%r" %>s %b "%{Referer}i" "%{User-Agent}i" %I %O" combinedio </IfModule>

# # The location and format of the access logfile (Common Logfile Format). # If you do not define any access logfiles within a <VirtualHost> # container, they will be logged here. Contrariwise, if you *do* # define per-<VirtualHost> access logfiles, transactions will be # logged therein and *not* in this file. # CustomLog "/private/var/log/apache2/access_log" common

# # If you prefer a logfile with access, agent, and referer information # (Combined Logfile Format) you can use the following directive. # #CustomLog "/private/var/log/apache2/access_log" combined
</IfModule>

<IfModule alias_module> # # Redirect: Allows you to tell clients about documents that used to # exist in your server's namespace, but do not anymore. The client # will make a new request for the document at its new location. # Example: # Redirect permanent /foo http://www.example.com/bar

# # Alias: Maps web paths into filesystem paths and is used to # access content that does not live under the DocumentRoot. # Example: # Alias /webpath /full/filesystem/path # # If you include a trailing / on /webpath then the server will # require it to be present in the URL. You will also likely # need to provide a <Directory> section to allow access to # the filesystem path.

# # ScriptAlias: This controls which directories contain server scripts. # ScriptAliases are essentially the same as Aliases, except that # documents in the target directory are treated as applications and # run by the server when requested rather than as documents sent to the # client. The same rules about trailing "/" apply to ScriptAlias # directives as to Alias. # ScriptAliasMatch ^/cgi-bin/((?!(?i:webobjects)).*$) "/Library/WebServer/CGI-Executables/$1"

</IfModule>

<IfModule cgid_module> # # ScriptSock: On threaded servers, designate the path to the UNIX # socket used to communicate with the CGI daemon of mod_cgid. # #Scriptsock /private/var/run/cgisock
</IfModule>

#
# "/Library/WebServer/CGI-Executables" should be changed to whatever your ScriptAliased
# CGI directory exists, if you have that configured.
#
<Directory "/Library/WebServer/CGI-Executables"> AllowOverride None Options None Order allow,deny Allow from all
</Directory>

#
# DefaultType: the default MIME type the server will use for a document
# if it cannot otherwise determine one, such as from filename extensions.
# If your server contains mostly text or HTML documents, "text/plain" is
# a good value. If most of your content is binary, such as applications
# or images, you may want to use "application/octet-stream" instead to
# keep browsers from trying to display binary files as though they are
# text.
#
DefaultType text/plain

<IfModule mime_module> # # TypesConfig points to the file containing the list of mappings from # filename extension to MIME-type. # TypesConfig /private/etc/apache2/mime.types

# # AddType allows you to add to or override the MIME configuration # file specified in TypesConfig for specific file types. # #AddType application/x-gzip .tgz # # AddEncoding allows you to have certain browsers uncompress # information on the fly. Note: Not all browsers support this. # #AddEncoding x-compress .Z #AddEncoding x-gzip .gz .tgz # # If the AddEncoding directives above are commented-out, then you # probably should define those extensions to indicate media types: # AddType application/x-compress .Z AddType application/x-gzip .gz .tgz

# # AddHandler allows you to map certain file extensions to "handlers": # actions unrelated to filetype. These can be either built into the server # or added with the Action directive (see below) # # To use CGI scripts outside of ScriptAliased directories: # (You will also need to add "ExecCGI" to the "Options" directive.) # #AddHandler cgi-script .cgi

# For type maps (negotiated resources): #AddHandler type-map var

# # Filters allow you to process content before it is sent to the client. # # To parse .shtml files for server-side includes (SSI): # (You will also need to add "Includes" to the "Options" directive.) # #AddType text/html .shtml #AddOutputFilter INCLUDES .shtml
</IfModule>

#
# The mod_mime_magic module allows the server to use various hints from the
# contents of the file itself to determine its type. The MIMEMagicFile
# directive tells the module where the hint definitions are located.
#
#MIMEMagicFile /private/etc/apache2/magic

#
# Customizable error responses come in three flavors:
# 1) plain text 2) local redirects 3) external redirects
#
# Some examples:
#ErrorDocument 500 "The server made a boo boo."
#ErrorDocument 404 /missing.html
#ErrorDocument 404 "/cgi-bin/missing_handler.pl"
#ErrorDocument 402 http://www.example.com/subscription_info.html
#

#
# MaxRanges: Maximum number of Ranges in a request before
# returning the entire resource, or one of the special
# values 'default', 'none' or 'unlimited'.
# Default setting is to accept 200 Ranges.
#MaxRanges unlimited

#
# EnableMMAP and EnableSendfile: On systems that support it, # memory-mapping or the sendfile syscall is used to deliver
# files. This usually improves server performance, but must
# be turned off when serving from networked-mounted # filesystems or if support for these functions is otherwise
# broken on your system.
#
#EnableMMAP off
#EnableSendfile off

# 6894961
TraceEnable off

# Supplemental configuration
#
# The configuration files in the /private/etc/apache2/extra/ directory can be # included to add extra features or to modify the default configuration of # the server, or you may simply copy their contents here and change as # necessary.

# Server-pool management (MPM specific)
Include /private/etc/apache2/extra/httpd-mpm.conf

# Multi-language error messages
#Include /private/etc/apache2/extra/httpd-multilang-errordoc.conf

# Fancy directory listings
Include /private/etc/apache2/extra/httpd-autoindex.conf

# Language settings
Include /private/etc/apache2/extra/httpd-languages.conf

# User home directories
Include /private/etc/apache2/extra/httpd-userdir.conf

# Real-time info on requests and configuration
#Include /private/etc/apache2/extra/httpd-info.conf

# Virtual hosts
#Include /private/etc/apache2/extra/httpd-vhosts.conf

# Local access to the Apache HTTP Server Manual
Include /private/etc/apache2/extra/httpd-manual.conf

# Distributed authoring and versioning (WebDAV)
#Include /private/etc/apache2/extra/httpd-dav.conf

# Various default settings
#Include /private/etc/apache2/extra/httpd-default.conf

# Secure (SSL/TLS) connections
#Include /private/etc/apache2/extra/httpd-ssl.conf
#
# Note: The following must must be present to support
# starting without SSL on platforms with no /dev/random equivalent
# but a statically compiled-in mod_ssl.
#
<IfModule ssl_module>
SSLRandomSeed startup builtin
SSLRandomSeed connect builtin
</IfModule>

Include /private/etc/apache2/other/*.conf

[tuinte]

I'm reviewing the Casper documentation regarding setting up Distribution Points, namely this bit:

Step 1: Set Up a New Distribution Point
1. Create a share point (AFP or SMB) on the server you want to utilize as the distribution point.
2. Create an account that has read-only access to the share.
3. Create an account that has read/write access to the share.
4. Make sure “Everyone” has read-only access to the share.
5. (Optional) Enable HTTP or HTTPS on the share point.

-
RE: Step 5. Where is this option? The Websites pane is turned on with two Server Website entries (port 80 and SSL on 443 - I understand this to be normal). Is turning this on and pointing port 80 to CasperShare enabling HTTP? If so, that looks to be enabled just fine. The policy error has the correct path to the test script (http://jss.server.ca:80/CasperShare/Scripts/_DisplayMessage.sh), so that suggests the setup portion in the JSS web interface is correct (right?).

I know I'm missing something basic. I mean, this is literally taking some files and making them available via the web. Sometimes I feel so stupid. Thanks again for any help!

Michael

[rtrouton · Accepted solution]

I was looking through your pasted httpd.conf and I'm not seeing where you set up an Apache alias that points back to the directory that stores your Casper repo. You should be able to edit the following section to set the alias information in Apache:

#
# Alias: Maps web paths into filesystem paths and is used to
# access content that does not live under the DocumentRoot.
# Example:
# Alias /webpath /full/filesystem/path
#
# If you include a trailing / on /webpath then the server will
# require it to be present in the URL. You will also likely
# need to provide a <Directory> section to allow access to
# the filesystem path.

--------

If you want to point your HTTP repository to http://server.name.here/casper, you would add the following line to /etc/apache2/httpd.conf:

-------

Alias /casper/ "/path/to/sharename/"

-------

The whole section should look like this:

--------

#
# Alias: Maps web paths into filesystem paths and is used to
# access content that does not live under the DocumentRoot.
# Example:
# Alias /webpath /full/filesystem/path
#
# If you include a trailing / on /webpath then the server will
# require it to be present in the URL. You will also likely
# need to provide a <Directory> section to allow access to
# the filesystem path.

Alias /casper/ "/path/to/sharename/"

--------

After that, restart Apache and see if you can access your repo over HTTP.

Thanks,
Rich

[tuinte]

Hey, Rich, thanks. I did the following:

Copied the httpd.conf file to the desktop and edited in the following line:

Alias /CasperShare/ "/Shared Items/CasperShare/"

FYI: CasperShare is the sharepoint created via the File Sharing pane of Server.app. It breaks down into CasperData, Scripts, Packages, etc.

I renamed the old httpd.conf file, then copied the modified one in and applied permissions from the parent folder (apache2). I restarted Tomcat via the JSS DatabaseUtility (Utilities > Restart Tomcat).

I really appreciate the help, Rich, but am getting the same thing. Any other ideas?

Michael

[tuinte]

Fascinating file, this httpd.conf. I notice the following line:

DocumentRoot "/Library/WebServer/Documents"

I had a look in there and there is an alias to CasperShare, the sharepoint with all the goods. Does this make the change I made earlier redundant?

Michael

[rtrouton]

Michael,

That depends on if the alias was there or not previously. I noticed that you said you had restarted Tomcat. Did you restart the Apache web service as well? Apache would need to be restarted in order for the httpd.conf file to be read again by your web server.

Rich

[bentoms]

Can you try & enable "Allow folder listing"

Details on how @ the below link:

http://krypted.com/mac-os-x/setting-up-and-using-web-services-in-os-x-mountain-lion-server/

I've needed to do this for my 10.8 servers.

[tuinte]

Ah, Rich, progress!

Still failing, but getting this now:

Creating directory structure for /Library/Application Support/JAMF/Downloads/ Downloading http://jss.server.ca:80/CasperShare/Scripts/_DisplayMessage.sh... Running script _DisplayMessage.sh... Script exit code: 2 Script result: /private/tmp/_DisplayMessage.sh: line 1: syntax error near unexpected token `newline'
/private/tmp/_DisplayMessage.sh: line 1: `<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">'

-

I tried deploying a dmg and it came back: Error: The package does not appear to be on the server (403).

403 rang some bells, so I tried accessing the index of the directory via a browser and get a "Forbidden, you don't have permission...".

Obviously I'm closer, not that I know what to do next. The Casper sharepoint has Read permissions for Everyone, and in the Websites pane, the Who Can Access dropdown has Anyone. Where might the permissions hiccup come from?

And, seriously, thank you.

Michael

[bentoms]

Try the folder listing setting.

[rtrouton]

It sounds like the script actually downloaded, which is a promising sign, though I'm not sure why it then failed to run.

I'd recommend what Ben has suggested, which is enabling the "Allow folder listing" setting.

[tuinte]

Hey, bentoms, welcome!

I've had the Allow Folder Listing box checked all along.

Michael

[bentoms]

Hmmm... I'd recheck the permissions on the CasperShare.

With the settings you've advised, you should be able to browse the CasperShare over HTTP.

[tuinte]

Permissions seem in order. casperadmin (read/write), casperinstall (read), everyone (read) from CasperShare all the way down to the packages/scripts themselves. I'll keep poking around.

Michael

[jarednichols]

MIME-types? IIS gave me a hell of a time with custom MIME-types, but that's IIS and it's a piece of shit. In my experience, Apache is easy peasy with this stuff. Then again, Apple bastardizes it when they cram it into Server...