U 2d5C@s\ddlZddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl m Z m Z mZmZmZddlmZmZddlmZddlmZeZeedd d ZeeeZGd d d ejZ Gd ddej!Z"Gdddej#Z$eddZ%ddZ&d[e ee fe ee fee ee fdddZ'dgfeeeedddZ(d\ee)e)e)dddZ*e ee fee)d d!d"Z+d#d$d%d&d'd(d)d*d+d,d-d.d/d0d&d1d2d3d4d5d6d7d8d9d:d;gZ,e,feeed<d=d>Z-eee)d?d@dAZ.eejdBdCdDZ/eedEdFdGZ0dHdIZ1dJdKZ2dLdMdNdOdPdQZ3eedRdSdTZ4eeeedUdVdWZ5e)dXdYdZZ6dS)]N)contextmanagerwraps)AnyDictListOptionalUnion) exceptionsmessages)CONFIG_FIELD_ENVVAR_ALLOWLIST)MessagingOperations)namereturncCs(|dkr dS|d}d|d<d|S)z1Replace the name of the root logger from __name__. ubuntupror)splitjoin)rnamesr//usr/lib/python3/dist-packages/uaclient/util.pyreplace_top_level_logger_names  rc@s.eZdZejdejdiZejedddZ dS) LogFormatterzERROR: %(message)szDEBUG: %(message)s)recordrcCs |j|jd}t||S)Nz %(message)s)FORMATSgetZlevelnologging Formatterformat)selfrZlog_fmtrrrr%szLogFormatter.formatN) __name__ __module__ __qualname__rZERRORDEBUGrZ LogRecordstrrrrrrrs rcs eZdZdZfddZZS)DatetimeAwareJSONEncoderzBA json.JSONEncoder subclass that writes out isoformat'd datetimes.cs t|tjr|St|SN) isinstancedatetimeZ isoformatsuperdefault)r o __class__rrr+-s z DatetimeAwareJSONEncoder.default)r!r"r#__doc__r+ __classcell__rrr-rr&*sr&cs,eZdZdZfddZeddZZS)DatetimeAwareJSONDecodera, A JSONDecoder that parses some ISO datetime strings to datetime objects. Important note: the "some" is because we seem to only be able extend Python's json library in a way that lets us convert string values within JSON objects (e.g. '{"lastModified": "2019-07-25T14:35:51"}'). Strings outside of JSON objects (e.g. '"2019-07-25T14:35:51"') will not be passed through our decoder. (N.B. This will override any object_hook specified using arguments to it, or used in load or loads calls that specify this as the cls.) cs.d|kr|dtj|d|ji|dS)N object_hook)popr*__init__r2)r argskwargsr-rrr4As z!DatetimeAwareJSONDecoder.__init__c CsN|D]@\}}t|trz t|}Wntk r>|}YnX|||<q|Sr')itemsr(r%parse_rfc3339_date ValueError)r,keyvalue new_valuerrrr2Fs   z$DatetimeAwareJSONDecoder.object_hook)r!r"r#r/r4 staticmethodr2r0rrr-rr13s r1c cs~td}|j}dd|D}|s6tddVdS|d}|j}|tjkrXdVdS|dz dVW5||XdS)a A context manager that disables logging to console in its body N.B. This _will not_ disable console logging if it finds the console handler is configured at DEBUG level; the assumption is that this means we want as much output as possible, even if it risks duplication. This context manager will allow us to gradually move away from using the logging framework for user-facing output, by applying it to parts of the codebase piece-wise. (Once the conversion is complete, we should have no further use for it and it can be removed.) (Note that the @contextmanager decorator also allows this function to be used as a decorator.) rcSsg|]}|jdkr|qS)z upro-console)r).0Zhandlerrrr hs z*disable_log_to_console..z0disable_log_to_console: no console handler foundNri)r getLoggerZhandlersLOGdebuglevelr$ZsetLevel)Z upro_loggerZ log_handlersZpotential_handlersZconsole_handlerZ old_levelrrrdisable_log_to_consoleUs$     rDcsfdd}|S)aDecorator to retry on exception for retry_sleeps. @param retry_sleeps: List of sleep lengths to apply between retries. Specifying a list of [0.5, 1] tells subp to retry twice on failure; sleeping half a second before the first retry and 1 second before the second retry. @param exception: The exception class to catch and retry for the provided retry_sleeps. Any other exception types will not be caught by the decorator. cstfdd}|S)Nc st}z ||WSk rl}z:|s.|dt|}tt||t|dW5d}~XYqXqdS)Nz Retrying %d more times.r)copylenrArBr%timesleepr3)r5r6ZsleepseZ retry_msg) exceptionf retry_sleepsrr decorators  z)retry..wrapper..decoratorr)rKrMrJrL)rKrwrappers zretry..wrapperr)rJrLrOrrNrretrys rPr) orig_dictnew_dictpathrc Csi}|D]\}}||t}|s(|n |d|}t|trp||krft||||d}|rn|||<qt||<q ||kr d|dt|d} t| |||<q |D]\}}||kr|||<q|S)z       rW)msg valid_choicesrcCsdddlm}|}d}d|ddd|D}||td}||krTq`||q4|S) aGInteractive prompt message, returning a valid choice from msg. Expects a structured msg which designates choices with square brackets [] around the characters which indicate a valid choice. Uppercase and lowercase responses are allowed. Loop on invalid choices. :return: Valid response character chosen. r event_loggerrz{} is not one of: {}z, cSsg|] }|qSr)upper)r>Zchoicerrrr?sz"prompt_choices..z> )uaclientr\get_event_loggerrrinfoinputlower)rYrZr\eventr;Z error_msgrrrprompt_choicess    rdF)rY assume_yesr+rcCs>|rdS|stj}t|}|dkr.|S|dkr:dSdS)a Display a confirmation prompt, returning a bool indicating the response :param msg: String custom prompt text to emit from input call. :param assume_yes: Boolean set True to skip confirmation input and return True. :param default: Boolean to return when user doesn't enter any text This function will only prompt a single time, and defaults to "no" (i.e. it returns False). Tr)yZyesF)r Z PROMPT_YES_NOrarbstrip)rYrer+r;rrrprompt_for_confirmationsrh)config path_to_valuercCs|}i}|d}|d}|D].}||kr.d}t|trF|||}qdSqt|}|dkrfdS|dkrvdSttj j |d|dd S) aKCheck if value parameter can be translated into a boolean 'True' value. @param config: A config dict representing /etc/ubuntu-advantange/uaclient.conf @param path_to_value: The path from where the value parameter was extracted. @return: A boolean value indicating if the value paramater corresponds to a 'True' boolean value. @raises exceptions.UserFacingError when the value provide by the path_to_value parameter can not be translated into either a 'False' or 'True' boolean value. rZfalseFtrueTzboolean string: true or false)rjZexpected_valuer;N) rr(rVrr%rbr ZUserFacingErrorr ZERROR_INVALID_CONFIG_VALUEr)rirjr;Z default_valuepathsZ leaf_valuer:Z value_strrrris_config_value_trues,     rnz(Bearer )[^\']+z(\'attach\', \')[^\']+z(\'machineToken\': \')[^\']+z(\'token\': \')[^\']+z((\'X-aws-ec2-metadata-token\': \')[^\']+z*(.*\[PUT\] response.*api/token,.*data: ).*z(https://bearer:)[^\@]+z1(/snap/bin/canonical-livepatch\s+enable\s+)[^\s]+z>(Contract\s+value\s+for\s+'resourceToken'\s+changed\s+to\s+).*z(\'resourceToken\': \')[^\']+z(\'contractToken\': \')[^\']+zF(https://contracts.canonical.com/v1/resources/livepatch\?token=)[^\s]+z(\"identityToken\": \")[^\"]+zT(response:\s+http://metadata/computeMetadata/v1/instance/service-accounts.*data: ).*z(\'userCode\': \')[^\']+z(\'magic_token=)[^\']+z(--registration-key=\")[^\"]+z(--registration-key=\')[^\']+z(--registration-key=)[^ ]+z(--registration-key \")[^\"]+z(--registration-key \')[^\']+z(--registration-key )[^\s]+z (-p \")[^\"]+z (-p \')[^\']+z (-p )[^\s]+) redact_regexsrcCs |}|D]}t|d|}q|S)z4Redact known sensitive information from log content.z\g<1>)resub)rXroZ redacted_logZ redact_regexrrrredact_sensitive_logs;srr)msg_opsrcCsXddlm}|}|sdS|D]2}t|tr:||q |\}}|f|s dSq dS)ahEmit messages to the console for user interaction :param msg_op: A list of strings or tuples. Any string items are printed. Any tuples will contain a callable and a dict of args to pass to the callable. Callables are expected to return True on success and False upon failure. :return: True upon success, False on failure. rr[TF)r^r\r_r(r%r`)rsr\rcZmsg_opZfunctorr5rrrhandle_message_operationsEs    rt)dt_strrcCsDtdd|}tdd|}|dd}tdd|}tj|d S) aT Parse a datestring in rfc3339 format. Originally written for compatibility with golang's time.MarshalJSON function. Also handles output of pythons isoformat datetime method. This drops subseconds. :param dt_str: a date string in rfc3339 format :return: datetime.datetime object of time represented by dt_str z(\d{2}:\d{2}:\d{2})\.\d+z\g<1>z(\d{2}:\d{2}:\d{2})$z\g<1>ZZz+00:00z(-|\+)(\d{2}):(\d{2})$z\g<1>\g<2>\g<3>z%Y-%m-%dT%H:%M:%S%z)rprqreplacer)strptime)ruZdt_str_without_subsecondsZ dt_str_with_zZdt_str_without_zZdt_str_with_pythonish_tzrrrr8as(  r8)messagercCs`tjjdksdtjjkr\|dd}|tjdd}|tjdd}|dd }|S) z} Verify if the system can output unicode characters and if not, remove those characters from the message string. NzUTF-8u—- rasciiignore) sysstdoutencodingr]rwr Z OKGREEN_CHECKZFAIL_Xencodedecode)ryrrrhandle_unicode_characterss  rcCsddtjDS)NcSs4i|],\}}|tks*|ds*|dkr||qS)Z UA_FEATURESZUA_CONFIG_FILE)rbr startswith)r>kvrrr s   z'get_pro_environment..)osenvironr7rrrrget_pro_environmentsrcCsdd}|D]\}}||}t|trFt|trFt|||qt|trt|trt|rt|dtr|||||dq|||<q|||<qdS)aMerge the contents of overlay dict into base_dict not only on top-level keys, but on all on the depths of the overlay_dict object. For example, using these values as entries for the function: base_dict = {"a": 1, "b": {"c": 2, "d": 3}} overlay_dict = {"b": {"c": 10}} Should update base_dict into: {"a": 1, "b": {"c": 10, "d": 3}} @param base_dict: The dict to be updated @param overlay_dict: The dict with information to be added into base_dict c Ssxdddd}g}||}|D]J}d}t|D]*\}} | |||kr.t| |d}q.|s||q||dS)NrtypeZselector)ZavailableResourcesZresourceEntitlementsZ overridesFT)r enumeratedepth_first_merge_overlay_dictappendextend) Z base_valuesZoverlay_valuesr:Zmerge_id_key_mapZvalues_to_appendZid_keyZ overlay_valueZ was_replacedZbase_value_idx base_valuerrrupdate_dict_lists   z8depth_first_merge_overlay_dict..update_dict_listr)r:N)r7rr(rVrlistrF)Z base_dictZ overlay_dictrr:r;rrrrrs  rZamd64Zi386Zppc64elZarm64Zarmhf)Zx86_64Zi686Zppc64leZaarch64Zarmv7l)archrcCs|}t||Sr')rb ARCH_ALIASESr)rZ arch_lowerrrrstandardize_arch_namesr)archesrcCs*t}|D]}|t|q tt|Sr')setaddrsortedr)rZdeduplicated_archesrrrrdeduplicate_archessr)rcCs tdkS)Nr)rgetuidrrrrwe_are_currently_rootsr)r)rFF)7r)Zjsonrrrpr~rG contextlibr functoolsrtypingrrrrr r^r r Zuaclient.defaultsr Zuaclient.typesr objectrUr%rr@r!rArrZ JSONEncoderr&Z JSONDecoderr1rDrPrWrdboolrhrnZREDACT_SENSITIVE_LOGSrrrtr8rrrrrrrrrrrs       " )   ! *   7 5