I am attempting to install SQL Server 2014 Standard edition on a new Windows Server 2016 set up as a domain controller that replaces a retired DC. (I know it's not recommended, but we are a small operation and have combined Windows Server domain controllers and SQL Server without problem for years. Performance has been fine on our small LAN.) All prerequisite checks pass except for the warning about installing on a DC. Service accounts are set to domain user accounts with sufficient privileges. SQL Server Setup gets near the end and throws this error as shown in the Summary Setup Log:
Feature: Database Engine Services
Status: Failed: see logs for details
Reason for failure: An error occurred during the setup process of the feature.
Next Step: Use the following information to resolve the error, uninstall this feature, and then run the setup process again.
Component name: SQL Server Database Engine Services Instance Features
Component error code: 0x84BB0001
Error description: A connection was successfully established with the server, but then an error occurred during the pre-login handshake. (provider: SSL Provider, error: 0 - The token supplied to the function is invalid)
The error help link displayed after this just takes me to a main Microsoft page, not any help text.
Our existing DC runs Windows Server 2008 R2 and SQL Server 2005 Standard. We have no connections to the SQL Server outside our LAN and are not running IIS or any web services on the servers. I am not sure where to start diagnosing and correcting this setup error. For example, do we need to install a certificate on our DCs? Can it be a self-signed certificate, since we are making connections to SQL Server only on our LAN? Can we use something like OpenSSL?